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OVERVIEW 

Particular  Teaming  events  and  activities  must  occur  In  the 
learning  environment  in  order  for  instruction  to  be  effective  and 
efficient.  Some  general  learning  guidelines  are  applicable  for  a 
variety  of  learning  objectives.  Other  guidelines  are  unique  to  each 
category  of  learning.  The  objectives  of  this  block  are  to  classify 
learning  objectives  according  to  the  appropriate  sub-category  within 
their  learning  category,  to  identify,  for  each  sub-category,  those 
learning  guidelines  necessary  for  optimum  learning  to  take  place,  and 
to  specify  activities  that  must  take  place  in  the  learning  environment 
to  provide  training  most  directly  related  to  task  performance. 


♦Portions  of  this  material  have  been  adapted  from:  Aagard,  J.  A,  and 
Braby,  R.  Learning  guidelines  and  algorithms  for  twelve  types  of  tralnin 
objectives  (TAEG  Report  No.  23}.”  Orlando’, ’PI . : ‘Training  Analysis  and 
Evaluation  Group,  NTEC,  (manuscript  from  to  be  published  in  mid-1075). 
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SPECIFY  LEARNING  EVENTS/ACTIVITIES 
1.0  INTRODUCTION 

The  objectives  of  this  block  are  to  determine  applicable  learning 
guidelines  and  to  specify  learning  activities  that  must  take  place  In 
the  learning  environment  to  help  make  sure  the  Instruction. Is  as  effec- 
tive and  efficient  as  possible,  and  1$  as  directly  related  to  task 
performance  as  possible. 

All  learning  objectives  do  not  require  the  same  specific  learning 
guidelines  for  optimum  learning  to  take  place.  Information  Is  not  best 
learned  the  same  way  as  a physical  skill.  This  block  provides  guidance 
for  separating  learning  objectives  Into  sub -categories  that  may  require 
different  Instructional  treatment.  Specific  Instructional  guidelines  are 
matched  with  the  different  sub-categories  of  objectives  so  the  Instruction 
can  be  as  effective  as  possible. 

The  term  "learning  guideline"  may  not  be  clear  at  this  point.  Some 
learning  guidelines  that  are  essential  to  teaching  a specific  learning 
objective  are  shown  In  the  following  example. 


EXAMPLE 


Suppose  the  learning  objective  is  "classify  a sonar 
target  as  'submarine'  or  'non-submarine'."  In  order 
to  teach  this,  the  activity  would  require  calling 
attention  to  the  important  features  that  distinguish 
one  pattern  from  another  pattern.  Then,  It  would 
require  providing  for  students  to  practice  making 
recognitions.  In  this  case,  "call  attention  to  the 
important  features  that  distinguish  one  pattern  from 
another  pattern"  and  "provide  for  students  to 
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practice  making  recognitions, " are  just  taro  of 
the  many  learning  guidelines  listed  In  this  block 
for  various  sub«categor1es  of  learning  objectives. 


Another  question  you  might  want  answered  is,  "what  should  be  done 
with  these  learning  guidelines?"  These  guidelines  will  be  helpful  In 
determining  learning  activities,  and  will  be  useful  In  Blocks  III. 2, 

III. 3,  and  III. 4 when  selecting  a management  plan  and  delivery  system, 
selecting  existing  materials,  and  developing  instruction.  The  objec- 
tives of  this  block  are: 

1.  to  identify  appropriate  learning  guidelines, 

2.  to  provide  guidance  for  their  use  In  selecting  or  developing 
appropriate  learning  materials  and  specifying  learning 
activities,  and 

3.  to  provide  guidance  for  using  learning  activities  In 
selection  of  appropriate  media  and  management  plans, 
and  In  developing  appropriate  learning  materials. 

The  steps  in  specifying  learning  events/activities  are  shown  In 
Figure  III.l,  the  fold-out  page  at  the  end  of  this  block. 


2.0  PROCEDURES 

2.1  Identify  General  Learning  Guidelines 
There  are  four  general  guidelines  that 
are  appropriate  for  most  learning  objectives. 
These  are: 

1.  Inform  the  learner  of  the 
objectives. 


mm 

c~i 


7 


1 


i 

t 


i 


2.  Provide  for  active  practice. 

3.  Provide  guidance  and  prompts  for  the  learner. 

4.  Provide  feedback  to  the  learner. 


These  learning  guidelines  will  assist  students  In  learning  a wide 
variety  of  new  knowledge,  skills,  and  attitudes.  In  determining 
exactly  how  to  implement  these  general  guidelines,  consider  their  ap- 
plication In  each  of  the  groups  of  objectives  resulting  from  the 
structuring  of  the  objectives  In  Block  II. 4.  Guidance  for  effective 
use  of  these  general  guidelines  Is  discussed  In  the  following  sections. 
The  guidelines  are  designed  to  provide  for  maximum  performance  training 
and  to  eliminate  non-essential  training. 


2.1.1  Inform  the  Learner  of  the  Objectives 


The  first  general  guideline  Is  for  the  learner  to  be  Informed  of 
the  objectives.  Students  meet  most  objectives  better  when  they  have  a 
clear  understanding  of  what  they  are  expected  to  learn.  The  best  way 
to  create  this  understanding  Is  to  inform  them  of  the  terminal  learning 
objectives. 


2.1.2  Provide  for  Active  Response 


The  second  general  learning  guideline  Is  active  responses  on  the 
part  of  the  student.  Students  learn  better  when  they  actively  practice 
the  new  learning.  Practice  on  performance  can  assist  in  learning 
faster,  improving  during  learning,  and  retaining  what  is  learned. 

Table  III.l  contrasts  the  Instructional  conditions  of  active  practice 
and  passive  conditions. 
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TABLE  111,1 

Contrasting  Instructional  Conditions:  Active  vs.  Passive 


ACTIVE  PRACTICE  CONDITIONS  PASSIVE  CONDITIONS 


During  learning,  the  student 

The  student  has  no  opportunity 

has  opportunity  to  produce, 

to  perform  the  task  to  be  learned 

practice,  or  ti^  his  hand  at 

until  after  instruction  has  been 

the  task  to  be  learned. 

completed. 

Student  practice  may: 

The  student  merely: 

♦Be  embedded  throughout 

♦Listens  to  Instructional 

Instructional  materials 

materials  about  the  actions 
to  be  learned 

♦Occur  at  wide  intervals 

♦Reads  about  the  actions  to 

♦Occur  at  the  end,  but  before 

be  learned 

tests  or  on-the-job 
performance 

♦Watches  a demonstration  of 

the  materials  to  be  learned 

♦Be  observable  or  unobservable 

Examples: 

Examples: 

♦Solving  problems 

♦Watching  instructor  solve 

problems  on  the  board 

♦Applying  principles  to 

exampl es 

♦Reading  about  application 

of  principles  to  examples 

♦Analyzing  data 

♦Watching  a demonstration  of 

♦Correcting  a malfunction 

i 

how  to  repair  a malfunction 
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2.1.3  Provide  for  Guidance  and  Promts 

Tne  third  general  learning  guideline  is  for  the  students  to  receive 
apDroprlate  guidance  and  promots.  Cues  or  prompts  before  the  perfor- 
mance can  help  students  perform  correctly  without  wasting  time  through 
trial  and  error  learning.  Guidance  during  early  performance  can  assist 
the  student  in  relating  new  learning  to  past  learning  and  in  focusing 
attention  on  specific  cues  of  things  to  watch  for  during  the  perfo-manoe. 

Cues  can  be  used  in  two  ways,  before  or  during  practice.  Table  II I. 2 
presents  cues  that  precede  practice  and  cues  that  accompany  practice, 

2.1.4  Provide  for  Feedback 


The  fourth  general  learning  guideline  is  for  the  students  to  receive 
appropriate  feedback.  In  order  for  practice  to  be  as  effective  as 
possible,  the  student  needs  to  have  feedback  about  his  performance. 

This  feedback  should  let  the  student  know  what  he  is  doing  wrong,  what 
he  is  doing  right,  and  how  he  can  improve  his  performance. 

Table  III. 3 conpares  natural  and  artificial  feedback.  Tables  III. 4 
and  III. 5 detail  types  of  artificial  feedback. 
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Precede  Practice  and  Cues  That  Accompany  Practice 
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Demonstrate  the  steps  involved  in  finding  a contain  two  syllables;"  "It  should  have  three 

square  root  on  a calculator.  Aft*  watching  distinct  parts." 

the  steps,  the  learner  practices  taking  the 
exact  same  steps. 


Table  III. 2 (Continued) 

Cues  That  Precede  Practice  and  Cues  That  Accosnpany  Practice 
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TABLE  III. 3 


Forms  Feedback  May  Take 


.NATURAL  FEEDBACK 

ARTIFICIAL  FEEDBACK 

Arises  naturally  from  the  task 
environment.  The  results  of  an 
action  taken  is  cne  type  of 
natural  feedback.  Another  would 
be  the  actual  product  or  object 
produced,  this  form  of  feedback 
Is  present  both  during  learning 
and  later  on  the  job.  Pushing 
a button  and  getting  a correct 
reading  on  an  instrument  is  one 
example. 

Does  not  arise  out  of  the  task 
itself.  It  Is  provided  by  ad- 
ditional means,  such  as  instructor 
critique  or  mechanical  Indicator. 
This  form  of  feedback  is  present 
only  during  learning  and  must  be 
carefully  planned.  (See  Tables 
III. 4 and  III. 5.) 

TABLE  III 

.4 

Types  of  Artificial  Feedback 

APPROPRIATE  ARTIFICIAL  FEEDBACK 

LESS  APPROPRIATE  ARTIFICIAL 
FEEDBACK 

Complete:  Provide  feedback  in 

the  context  of  the  learning 
material . 

Incomplete:  Merely  indicate 
right  or  wrong. 

Immediate;  Give  correction 
immediately  after  each  practice 
trial. 

Delayed:  Give  all  the  answers 
at  the  end  of  an  exercise. 

Similarity:  Like  the  product  or 
action  produced  by  the  student, 
for  example,  provide  a standard 
against  which  the  student  may 
compare  his  output. 

Dissimilarity:  Different  from 

the  product  or  action  produced 
by  the  student.  For  example, 
provide  a checklist  as  to  what 
the  product  should  be  like, 
rather  than  the  product  Itself. 

Specific:  Identify  errors  in 

the  performance. 

General:  Give  a grade. 

nuilm,<iliiiiiu  flhiiilluuiiiiil  kiiiiJiiL»iHU4iiUidti4lhiilkllihlu-  LL.lJJilKeun 
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EFFECTIVE 


LESS  EFFECTIVE 


Spanish  student  practices  saying 
a word  and  immediately  hears  the 
correct  word  sp'tken  on  a tape. 
Practice  and  feedback  are  same 
mode. 

A man  learning  to  fi il  out  forms 
compares  his  completed  forms 
with  standards.  The  standards 
he  uses  are  filled  out  on  the 
same  exercise  he  is  practicing. 

A student  Is  learning  to  set  up 
laboratory  equipment.  After 
setting  up  the  equipment,  he  is 
shown  a mockup  of  the  correct 
setup  to  compare  his  setup  with. 

A student  Is  learning  to  solve 
algebraic  equations.  His  feed- 
back Includes  all  steps  in  the 
equation,  allowing  him  to  check 
each  step  In  his  answers. 


Student  practices  saying  a word 
and  the  correct  phonetic  spelling 
Is  flashed  on  a screen  immediately 
afterward.  Practice  and  feedback 
are  In  different  modes. 

The  standards  used  for  comparison 
are  filled  cut  with  another  exer- 
cise. Here  the  content  of  the 
feedback  Is  different. 


A student  Is  given  a verbal  des- 
cription of  a correct  laboratory 
setup  to  determine  If  his  Is 
correct.  His  setup  is  visual , 
but  the  feedback  Is  verbal. 

Feedback  is  Indicated  only  by 
statement  of  right  or  wrong.  If 
his  answer  Is  wrong,  he  has  no 
way  of  determining  where  he  went 
wrong. 
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are  not  sufficient  In  themselves  lo  produce  effective  and  efficient 
Instruction.  You  also  need  to  Include  the  specific,  unique  learning 
guidelines  for  different  categories  and  sub-categories  of  objectives. 

The  first  step  In  Identifying  those  unique  guidelines  Is  to  classify' 
each  learning  objective  according  to  Its  learning  category.  Once  the 
appropriate  learning  category  has  been  specified  (this  takes  place  In 
II. 1 when  developing  objectives)  the  appropriate  sub-category  of  learning 
within  each  category  needs  to  be  determined.  This  classification  step 
also  will  be  helpful  in  Block  III. 2 when  you  begin  the  task  of  speci- 
fying the  Instructional  management  plan  and  delivery  system. 

The  categories  and  sub-categories  with  which  you  will  be  concerned 

are: 

SUB-CATEGORY 

1.  Rule  Learning  and  Using 

2.  Classifying-Recognizing  Patterns 

3.  Identifying  Symbols 

4.  Detecting 

5.  Making  Decisions 

6.  Recalling  Bodies  of  Knowledge 

7.  Performing  Gross  Motor  Skills 

8.  Steering  and  Guiding-Continuous 
Movement 

9.  Positioning  Movement  and  Recalling 
Procedures 

10.  Voice  Communicating 

11.  Attitude  Learning 


» LEARNING  CATEGORY 

I.  Mental  Skill: 

II.  Information: 

III.  Physical  Skills: 


IV.  Attitude: 


ft 


Table  III, 6 lists  behavioral  attributes,  learning  objective  action 
verbs,  and  examples  for  each  sub-category  of  learning.  To  classify  each 
of  your  learning  objectives  into  one  of  the  learning  sub-categories,  check 
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the  learning  objective  against  the  inforraatlcn  given  for  each  category, 
and  decide  In  which  category  It  fits  best. 

If  you  have  difficulty  fitting  a learning  objective  Into  a single 
sub-category  because  It  seems  to  fit  equally  well  In  several  sub-categories, 
the  learning  objective  may  not  be  specific  or  clear,  the  action  required 
may  be  two  or  more  objectives  or  it  may  have  other  faults.  Decide  what 
in  the  objective  will  require  the  most  Instruction.  Place  the  objective 
in  that  category. 


EXAMPLE 


The  learning  objective  might  be  "Paint  barracks 
when  painting  is  needed."  Applying  the  paint  is 
a repetitive  mechanical  skill,  and  the  objective 
fits  sub-category  7,  performing  gross  motor  skills. 
However,  knowing  when  painting  is  needed  requires 
choosing  a course  of  action  based  on  applying  known 
rules,  and  the  objective  also  fits  sub-category  1, 
rule  learning  and  using.  Divide  the  original 
objective  Into  two  new  ones:  "Paint  the  barracks," 
and  "Identify  that  barracks  needs  painting." 


2.3  Identify  Specific  Learning  Guidelines  for  Each  Sub-Cate 


guidelines  given  for  each.  Generally,  you  will  select  a subset  of  these 
guidelines  rather  than  attempt  to  use  all  of  them.  These  guidelines  will 
be  essential  for  carrying  out  the  Review/Select  Existing  Material  activity 
In  Block  111.3  and  the  Develop  Instruction  Activity  In  Block  111.4. 

In  addition  to  the  list  of  learning  guidelines,  each  learning  sub- 
category has  a flowchart  diagramming  suggested  techniques’ and  conditions 
for  Introducing  the  appropriate  learning  guidelines. 

The  written  Information  is  contained  In  a flowchart  and  presented 
with  symbols  of  various  shapes.  It  Is  the  shape  of  the  symbol  which 
indicates  the  purpose  of  the  Information  and  how  It  can  help  In  the 
procedures  of  the  sub-category  in  question.  The  significance  of  these 
synbols  will  be  discussed  briefly. 

Rectangles  contain  specific  instructions  for  

activities  which  should  be  carried  out  by  the  

Instructor. 

Hexagons  contain  further  explanation  or 
additional  Information  to  aid  the  Instructor  In  ^ ^ 

carrying  out  the  activity  of  the  instruction 


symbol , 

Diamond-shaped  synbols  indicate  a decision 
point.  It  Is  at  this  point  In  the  Instructional 
process  that  an  answer  to  the  question  contained 
in  the  diamond  should  enable  the  instructor  to 
make  a decision  regarding  future  activities. 

Horizontal  triangles  represent  sub-routines 
and  present  an  activity  or  suggestion  designed  to 
help  answer  the  decision  point  question. 


O 


19 


1 


A 


CD 


Vertical  triangles  represent  an  optional 
rest  or  stopping  point  between  activities  or 
decisions. 

Finally,  an  oval  shape  represents  points 
at  which  (me  may  enter  or  exit  from  the 
activities  described  by  the  flowchart. 

By  beginning  at  the  oval  marked  “start''  and  proceeding  through  the 
information  and  suggestions  contained  in  the  symbols  described  previously, 
an  Instructional  developer  can  follow  the  procedural  steps  listed  for 
the  particular  sub-category. 

Use  the  learning  objective  action  statement,  conditions,  standards, 
and  the  test  Item  to  help  select  which  guidelines  to  apply  to  the  specific 
learning  objective  or  group  of  learning  objectives.  This  will  require 
some  judgment.  But  remember,  you  are  trying  to  limit  Instruction  to 
that  which  Is  essential  to  mastery  of  the  learning  objective.  You  will 
use  the  Instruction  with  students  Informally  in  Block  III. 4 and  formally 
in  Block  III. 5.  If  It  does  not  work,  come  back  to  this  block  and  add  or 
change  learning  guidelines.  Select  guidelines  that  make  sense  for  the 
objective. 


EXAMPLE 

If  you  have  a CLASSIFYING  objective  like  “Identifying 
poisonous  plants,"  when  you  get  to  guideline  16,  "To 
test  learning,  require  the  trainee  to  provide  new 
examples  of  the  pattern,"  you  know  that  this  Is 
Inappropriate.  Designing  new  poisonous  plants  would 
not  help  the  learner  Identify  existing  ones. 


A 
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There  are  two  alternatives  for  selecting  learning  events.  You  may 
use  the  decision  trees  (flowcharts)  or  the  learning  guidelines.  The 
end  result  should  be  very  much  the  same,  as  the  guidelines  are  derived 
from  the  algorithms.  Examples  using  each  alternative  follow. 


EXAMPLES 


1.  Using  flowcharts  — 


1)  Classify  pictures  o?  ships  as 
US  or  USSR.  Students  will  identify 
pictures  of  US  or  USSR  ships.  In 
an  operational  setting,  students 
will  identify  ships  and  be  pre- 
pared to  take  appropriate  action. 


2)  Pretest. 


3)  Present  ships  that  look  alike. 


4)  Present  each  ship  with  the 
unique  features  emphasized. 


5)  Tell  the  student  when  he 
Is  right,  and  the  correct 
classification  wnen  he  Is 
wrong  and  why. 


2.  Using  guide’  iec--Sub-category  2,  CLASSIFYING 

Learning 
Guideline  3 

1)  Learning  objective  action  statement:  Classify 
pictures  of  ships  as  US  ,nd  USSR. 

Operational  task:  From  ships  or  from  the  air 

classify  other  ships  as  friendly  or  enemy.  Be 
prepared  i.o  take  appropriate  action. 

2)  Present  each  ship  with  unique  features 
emphasized 


3) 


4) 

5) 


6) 

7) 


8) 


9) 

10) 


11) 

12) 


13  & 14) 
15) 


16) 

17) 
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Present  ships  that  look  alike  and  show  how 
they  are  different.  (Last  part  about  dis- 
tinctive features  not  to  be  classified  in 
the  training  task  Is  irrelevant  In  this 
objective.) 


Association  devices-use  diagrams  of  the 
ships  or  in  this  case  drawings. 


Present  examples  of  US  and  non-examples  of 
US.  In  this  case,  non-examples  will  be  USSR. 
Present  easily  confused  or  similar  ships 
together. 


Start  with  easier  ships  and  work  up  to  the 
ones  thut  are  more  difficult  to  discriminate. 


Reward  student  early  in  training,  decrease  the 
reward  as  the  training  progresses  until  It 
matches  the  "reward"  (If  any)  on  the  job. 


Provide  as  much  practice  as  is  needed  for 
trainees . 


Provide  i (mediate  KQR. 


Let  the  student  check  why  he  was  right  or 
wrono  and  correct  errors. 


Go  from  diagram  or  drawings  to  pictures  of 
real  ships. 


Include  any  camouflage  or  distractions  that 
might  occur  in  the  real  world. 


Allow  all  trainees  plenty  of  time  and  practice. 


Keep  the  job  task  in  mind  and  keep  students 
looking  at  critical  cues. 


This  is  not  appropriate,  The  student  cannot 
design  either  a US  or  USSR  ship. 


The  criteria  may  be  set  at  1002  for  this  learning 
objective.  (There  is  some  evidence  that  people 
have  about  an  80  aircraft  or  ship  memory  bank  and 
that  is  maximum.)  Do  not  try  to  exceed  people's 
capacity.  Provide  review  on  time. 


iaiifciihrilfali.,. 
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2.4  Specify  Learning  Activities 

While  learning  guidelines  are  suggestions 
for  learning  stimuli  for  categories  and  sub- 
categories of  learning  objectives,  a 
learning  activity  Is  specific  to  a particular 
learning  objective.  How  to  specify  learning 
activities  is  shown  in  the  following  example. 


EXAMPLE 

The  terminal  learning  objective  is:  Identify 
US  and  USSR  destroyers.  Some  of  the  learning 
objectives  are: 


LEARNING 

SUB-CATEGORY 

Classifying 

Classifying 

Classifying 

Classifying 

Classifying 


OBJECTIVE 

1.  Classify ‘Claud  Jones  Class  as  US  or  USSR. 

2.  Classify  Forrest  Sherman  Class  as  US  or 
USSR. 

3.  Classify  KOTLIN  Class  as  US  or  USSR. 

4.  Classify  RICA  Class  as  US  cr  USSR. 

5.  Classify  KOLA  Class  as  US  or  USSR. 


The  learning  guidelines  for  all  five  objectives  are  so 
similar  that  you  m-iy  make  decisions  for  the  whole  group 
at  the  same  time.  After  selecting  the  learning 
guidelines  appropriate  for  the  objectives,  the  next  step 
is  to  specify  how  to  carry  out  that  guideline  in  ins  true 
tlon.  This  specification  is  the  learning  activity.  The 
activity  specifies  how  to  go  about  accomplishing  the 


learning  guidelines. 

LEARNING  LEARNING 

GUIDELINE  # GUIDELINE 

CORRESPONDING  ACTIVITY 

i 

1. 

Clearly  inform  the 

State  the  objective  in 

k 

trainee. 

writing. 

3. 

Display  distinctive 
features  of  the  pattern. 

Call  attention  to  the 
differences  in  each  ship 
In  pictures . 

* 

8. 

Provide  opportunities 
for  practice. 

Practice  identifying  by 
looking  at  pictures  with 
correct  identification 
available  immediately. 

11. 

Provide  full  range  of 
patterns . 

Show  varying  views  of  the 
ships. 

:A 


I 


\ 


2b 

You  could  have  chosen  more,  but  try  these  and  if 
they  are  not  effective,  change  them  later.  If  you 
use  too  many,  it  will  be  hard  to  identify  the  un- 
needed activities. 

The  specified  activities  will  be  used  to  select  the  delivery  system, 
and  therefore,  affect  both  the  davelopr  ni  and  Implementation  costs. 

Keep  the  following  general  comparative  costs  in  mind  when  specifying 
activities. 

1.  Color  Is  more  expensive  than  black  and  white. 

2.  Film  is  more  expensive  than  television. 

3.  Motion  is  more  expensive  than  stills. 

4.  Print  is  usually  the  least  expensive. 

For  high-flow  courses,  the  development  costs  are  spread  over 
high  numbers  of  learners  and  therefore  allow  more  choices.  There  are 
often  economies  of  scale  in  production  and  implementation  of  instruction. 
That  is,  printing  one  color  microfishe  might  cost  $75  but  50  of  them 
will  also  cost  a total  of  $75,  or  $1.50  for  each.  If  1,000,  are  required, 
the  cost  per  "fische"  will  drop  significantly.  Therefore,  keep  in 
mind  how  many  users  there  will  be. 

The  learning  objective  conditions  will  influence  the  learning 
activities.  If  the  learner  must  identify  the  ships  from  the  airwhen 
he  is  moving  rapidly,  the  activities  may  be  different  than  if  the 
learner  must  identify  the  ship  from  another  ship,  or  just  in  pictures. 

The  learning  objective  standards  also  will  influence  the  speci- 
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fi cation  of  learning  activities.  If  to  pass,  the  learners  have  to 
identify  ships  within  2 seconds,  activities  must  be  chosen  that  will 
bring  them  to  that  level  of  performance. 


I 


r 


i 


26 

When  you  have  planned  the  activities,  write  them  In  the  space 
provided  or,  the  worksheet.  (See  Figure  III. 2.) 

3.0  OUTPUTS 

The  outputs  of  this  block  should  consist  of: 

3.1  Products 

1.  Documentation  of  the  category  and  sub-category  Into  which 
each  learning  objective  was  classltv  1.  (See  example, 
page  20. ) 

2.  Learning  guidelines  selected  for  each  learning  objective 
or  group  of  learning  objectives.  (See  example,  page  28.) 

3.  Learning  activities  specified  for  each  learning  objective 
or  group  of  learning  objectives. 

3.2  Other  Documentation 

1.  A sunmary  statement  of  areas  where  learning  activities 
are  more  likely  to  require  revision  or  additions  after 
evaluation. 

2.  A summary  statement  of  the  rationale  for  any  revisions 
to  learning  objectives  resulting  from  the  classification 
process,  and  a summary  statement  of  how  the  requirements 
of  Blocks  II. 2,  II. 3,  and  II. 4 were  satisfied  for  these 
revised  items. 
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EXAMPLES 

1.  Sample  Documentation  of  Categories  and  Sub-Categories 
for  Tasks  of  OH-58  Helicopter  Repairman-Action  Compo- 
nents Only: 

1.  Lubricate  main  drive  shaft:  Physical  ski 11- 
Performing  gross  motor  skills 

2.  Disassemble  tall  rotor  disc  assembly:  Physical 

ski  11 -Positioning  movement  and  recalling  procedures 

3.  Inspect  main  transmission  mast  assembly:  Physical 
ski  11 -Positioning  movement  and  recalling  procedures 

2.  Sample  Learning  Guidelines  and  Learning  Activities  for 
the  Learning  Objective:  Using  a job  aid  (partially 
shown  below)  and  general  mechanics  tool  kit,  determine 
main  rotor  vibrations  and  correct  to  less  than  1:1. 

Learning  Objective- 

Action:  Determine  and  correct  main  rotor  vibrations. 

Condition:  Using  the  job  aid  (partly  shown  below)  and  general  mechanics 
tool  kit. 

Standard:  Vertical  vibrations  must  be  less  than  1:1  after  correction. 
Job  Aid  with  Rules:  ; yg-— — — i 
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Check  the  1:1  Lateral  vibration  level 
at  high  and  low  beep  on  the  governor 
actuator.  U the  amplitude  of  the 
lateral  is  worse  at  103%  N2.  the 
lateral  is  probable  from  spanwlse 
balance.  If  it  is  worse  at  101%N2  the 
lateral  is  probably  caused  by  rhord- 
wtse  balance  problems. 


If  span  wise,  add  two 
wraps  of  i -inch  tape 
on  one  blade.  (U  the 
lateral  is  mild,  use 
one  wrap.)  if  this  is 
wo.’se,  remove  the 
tape  and  put  it  on  the 
opposite  blade.  Add 
tape  in  1-wrap  or 
1/2-wrap  increments 
until  the  smoothest 
high- PPM  level  is 
reached.  Recheck 
low  PPM  97%  N2 
level  now. 


0 

if  work!  »t  low  BPM. 
sweep  one  blade  *ft 
1/2  point.  If  this  it 
worse,  remove  the 
sweep  end  sweep  the 
opposite  blade  aft 
1/2  point.  Sweep 
until  the  best  low 
RPM  lateral  vibra- 
tion level  it  obtained. 
Recheek  the  high 
RPM  level  before 
proceeding  further. 
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liaxagonal  figures  In  the  flowcharts  contain 
details  of  what  Inputs  are  needed. 
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Once  the  objective  Is  stated,  the  next 
step  Is  a decision  to  give  a test  to 
determine  If  the  student  can  perform 
the  objective  (these  test  Items  have 
been  developed  In  Block  II. 2).  If 
the  decision  Is  to  administer  the  test 
and  the  student  passes  It,  he  does  not 
need  the  instruction  for  this  learning 
objective.  If  the  decision  Is  not  to 
administer  the  test  or  the  student  falls 
the  test,  the  next  step  is  to  teach  the 
rules,  (this  objective  includes  a series 
of  rules).  For  this  example,  the  first 
rule  selected  for  Instruction  Is  the 
rule  described  In  block  6 of  the  Job 
Aid  about  wrapping  the  blades. 
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The  student  Is  then  pretested  to 
determine  If  he  can  recall  the 
concepts  upon  which  the  rule  Is 
built  (these  concepts  can  be 
found  in  the  learning  analyses). 
For  example,  such  concepts  as  N, 
RPM,  s panwise  balance,  chordwlse 
balance,  lateral  vibrations,  etc., 
need  to  be  tested.  The  student's 
understanding  of  the  concepts  is  a 
necessary  prerequisite  before 
further  learning  of  the  task  can 
be  started. 


If  the  student  understands  the 
concepts  for  the  rule  he  is 
learning,  the  next  step  is  to 
laam  the  rule.  If  he  does  not 
understand  the  concepts,  he  must 
be  taught  the  concepts  (sub -routine) 
and  retested. 


Learning  Analysis  Underlying  Concepts 
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After  knowledge  of  the  concepts  Is 
obtained,  instruction  for  the  rule 
begins.  In  this  case,  the  student 
would  learn  to  describe,  by  stating, 
the  rules  for  wrapping  the  blades. 
(Job  Aid  steps  5 & 6)  Also, 
mnemonics  could  be  developed  If 
appropriate. 

The  next  step  is  to  encourage  the 
students  to  develop  their  own 
personal  mnemonics. 

The  next  step  usually  is  to  deter- 
mine If  the  student  can  state  the 
rule  verbally.  This  does  not  have 
to  be  verbatim,  but  should  state 
the  essential  meaning  of  the  rule. 
Following  this  statement,  the 
student  Is  given  knowledge  of 
results  (KOR).  If  the  student 
cannot  state  the  rule  verbally,  he 
recycles  in  the  flowchart  to  the 
select  and  display  box. 

In  this  case  the  student  has  a Job 
Aid  with  the  rule  on  It  so  there 
Is  no  need  to  memorize  the  rule. 
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If  the  student  can  state  the 
rule  verbally  the  next  step 
involves  presenting  examples  of 
when  the  rule  does  and  does  not 
apply. 


The  rule  is  to  add  two  wraps  of 
1 inch  tape  cn  one  blade  If  the 
lateral  vibration  Is  from  spanwise 
balance.  The  next  rule  applies  If 
the  lateral  Is  mild— use  only  one 
wrap.  The  third  rule  is  used  If 
the  wraps  made  the  situation  worse.  * 

It  is  during  this  step  that  the 
rule  is  taught. 

To  test  whether  the  student  can 
apply  the  rule  and  knows  when  to 
apply  the  rule,  the  next  step 
involves  presenting  the  student  with 
a new  situation  where  he  determines 
if  the  rule  should  be  applied,  and 
applies  the  rule  when  appropriate. 

Following  this  step  the  student  is 
given  knowledge  of  results  (KOR) 
based  on  his  responses. 

If  the  student  was  Incorrect,  he  is 
recycled  to  that  part  of  the  flow- 
chart in  which  he  is  presented  with 
examples  of  when  not  to  apply  the 
rule. 


If  the  student  is  correct,  he  is 
tested  in  the  next  step,  by  having 
him  state  why  the  rule  is  appropriate 
or  inappropriate  and  the  relation- 
ship between  the  concepts  contained 
In  the  rule.  KOR  is  then  given  based 
on  the  students  response. 


If  the  student  is  incorrect,  pointed  questions  which  guide  the  student 
to  the  appropriate  responses  are  asked  prior  to  the  student  being  re- 
cycled to  the  testing  situation. 


If  the  student  is  correct,  the  next  decision  to  make  is  to  determine  if 
the  student  has  met  the  criterion.  If  the  student  has  not  met  the  criterion, 
he  is  recycled  to  the  test  where  he  is  required  to  apply  the  rule  under 
appropriate  situations. 
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If  the  student  has  met  the  criterion 
set  for  the  learning  objective  he  is 
given  reinforcement.  Following  this 
step,  a rest  may  be  Initiated  prior  to 
going  on  to  learning  the  next  rule. 

Once  all  the  rules  have  been  mastered 
the  next  step  Involves  making  a status 
report  on  the  student. 

At  this  point  in  the  flowchart  students 
are  presented  with  practical  problems 
calling  for  the  use  of  one  of  the  rules 
already  learned  (in  the  rule  pool).  The 
student  is  recycled  through  a procedure 
of  problem  presentation,  KOR,  assessment 
of  answers,  the  reduction  of  reinforce- 
ment if  the  answer  is  correct  and  the 
criterion  has  been  met.  If  the  student 
is  not  correct  or  does  not  meet  the 
criterion,  prompted  examples  are  given 
until  the  students  can  apply  all  the 
rules  to  criterion  without  prompts. 

This  concludes  the  procedures  followed 
in  developing  guidelines  and  activities 
for  learning  objectives  categori2ed  as 
rule  learning  and  using. 


f 


ppMWOTPW1"  W '“‘PHHWwpn  “iPurw1  w* 


\ 


1.  At  the  beginning  of  the  training,  the  Instructor  or  the  materials 
should  clearly  Inform  the  trainee  of  the  learning  objectives;  that 
is,  what  the  trainee  Is  expected  to  be  able  to  do  by  the  completion 
of  training.  Relate  the  objectives  and  learning  activities  to 
operational  tasks  which  the  trainee  must  perform  in  future  real- 
world  assignments. 

2.  Make  sure  that  the  student  can  recall  and  demonstrate  the  concepts 
which  make  up  the  rule.  Then  go  on  to  learning  the  rule. 

3.  Require  the  learner  to  state  the  rule  verbally.  This  verbal  state- 

ment helps  the  learner  recall  which  concepts  make  up  the  rule  and 
how  the  concepts  are  arranged.  This  should  usually  be  an  informal 
statement  of  the  rule  in  the  learner's  own  words. 

4.  Present  examples  of  when  the  rule  applies,  and  when  it  doesn't. 

5.  Provide  opportunities  to  apply  the  rule  in  a variety  of  new  situations 

in  which  the  learner  has  not  previously  been  trained  to  apply  the 

rule.  During  practice,  practical  applications  and  practice  tests 
provide  the  student  with  immediate  knowledge  of  results  about  his 
correct  and  incorrect  answers  Provide  rewards  for  correct 
application  of  the  rule. 

6.  To  test  the  learner's  understanding  of  the  rule,  provide  an 
unfamiliar  situation  in  which  the  rule  can  be  applied,  and  then 
require  the  learner  to  tell  how  the  concepts  of  the  rule  are  related 
to  each  other  and  to  this  situation  in  order  to  show  that  he  is  able 
to  state  how  arid  why  the  rule  can  be  applied. 
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7.  Provide  practice  until  the  student  achieves  the  desired  level  of 
performance;  that  is,  until  he  learns  the  rules  and  learns  to  apply 
the  rules  he  will  use  in  the  operational  job  setting. 

8.  Positive  rewards  of  the  student's  correct  applications  of  the  rules 
learned  is  required  in  the  early  stages  of  training.  Toward 

the  end  of  training,  the  level  of  positive  rewards  for  correct 
performance  should  be  reduced  to  the  same  level  that  t.he  student 
will  find  on  the  job. 

9.  Relate  the  rules  to  be  learned  to  operational  tasks  which  the 

trainee  must  perform  in  future  real  world  assignments, 

10.  Different  trainees  w.l1  have  different  r->tes  and  styles  of  learning 
the  material.  It  is  better  to  u.?  techniques  which  allow  students 
flexibility  in  learning  time. 

11.  Reduce  forgetting  by  providing  periodic  practice  or  refresher 
training  for  infrequently  used  material. 

12.  In  order  for  slower  learners  to  reach  the  same  level  of  proficiency 
as  faster  learners,  time  must  be  allowed  for  the  slower  learner  to 
get  as  many  positive  rewards  for  correct  applications  of  the  rules 
learned  as  the  faster  learner, 

13.  inhere  it  seems  possible,  supply  students  with  diagrams,  pictures, 
charts,  graphs,  rhymes,  key  words,  and  other  association  devices 
(mnemonics)  which  the  student  can  use  to  relate  what  he  already 
knows  to  what  he  is  trying  to  learn.  Also  encourage  students  to 
make  up  their  own  mnemonics  if  they  can  and  want  to  do  it. 
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14.  Pick  out  the  features  of  the  real  world  job  environment  which  could 
be  used  to  trigger  the  trainee's  recall  of  associated  materials 
which  must  be  used  in  the  rule  using  part  of  his  job.  Some  features 
of  the  real  world  job  setting  where  the  rules  will  be  applied  can 
sometimes  be  used  to  trigger  the  recall  cf  associated  material  that 
has  not  been  directly  trained  that  can  be  used  in  rule  using. 

15.  Where  the  learner  is  having  a particularly  difficult  time  trying  to 
leam  and  apply  a rule,  help  him  learn  the  rule  by  discovering  how 
the  concepts  are  related  to  each  other  by  using  specific  questions 
which  will  help  the  learner  to  state  the  elements  and  relationships 
in  the  rule.  Once  the  learner  has  discovered  the  rule  elements  by 
this  ;;iethod,  he  should  be  aole  to  (1)  easily  recall  the  rule, 

(2)  state  the  elements  and  their  relationship  in  the  rule,  and 

(3)  be  able  to  apply  the  rule  to  job  situations. 
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SU&-CATEOGRY  2:  CLASSIFYING  - RECOGNIZING  PATTERNS 

1.  At  the  beginning  of  the  training,  the  instructor  or  the  materials 
should  clearly  Inform  the  trainee  of  the  training  objectives;  that 
is,  what  the  trainee  is  expected  to  be  able  to  do  by  the  completion 
of  training.  Organize  the  training  material  in  such  a way  that  the 
trainee  can  meet  the  training  objectives  at  the  end  of  training. 
Relate  the  objectives  and  learning  activities  to  operational  tasks 
which  the  trainee  must  perform  in  future  real  world  assignments. 

2.  Call  student  attention  to  the  Important,  distinctive  features  and 
characteristics  of  a pattern  which  distinguish  this  pattern  from 
other  patterns.  Be  sure  that  the  distinctive  features  will  be 
present  in  the  student's  real-world  job  environment,  for  these 
features  are  the  cues  by  which  the  student  must  recognize  the 
pattern . 

3.  Clearly  display  each  of  the  distinctive  features  of  the  pattern 
under  study.  Show  how  these  cues  differ  from  each  other  (pre- 
differentiation  of  stimuli).  Determine  if  the  trainee  can  de  :ect 
these  distinctive  features  in  patterns  that  are  not  to  be  classified 
or  recognized  in  the  training  task. 

4.  Emphasize  distinctive  features  which  can  be  remembered  in  the  form 
of  mental  "pictures"  instead  of  abstract  words.  When  possible, 
supply  students  with  diagrams,  pictures,  charts,  graphs,  rhymes, 
acronyms,  key  words,  self  instructions,  common  associations,  and 
other  association  devices  like  these  to  which  the  student  can  relate 
the  material  he  is  trying  to  learn.  Also  teach  students  to  transform 


distinctive  features  of  the  patterns  Into  Items  that  they  can 
readily  recall  and  make  correct  actions  to. 

.*».  In  Instructional  presentations  and  practice,  many  exanples  and 
non-examples  of  the  pattern  should  be  presented.  Toward  the  end 
of  training,  present  examples  and  non-examples  that  will  be  very 
similar  to  each  other  in  the  job  environment. 

6.  In  early  training  there  should  be  few  irrelevant  features,  so  that 
Identifying  the  distinctive  characteristics  of  the  pattern  Is  fairly 
easy.  By  the  end  of  training,  the  number  of  irrelevant  cues  should 
be  Increased  to  correspond  with  the  real-life  situation. 

7.  Positive  rewards  of  the  students'  correct  recognizing  of  patterns 
is  required  in  the  early  stages  of  training.  Toward  the  end  of 
training,  the  level  of  positive  rewards  for  correct  performance  should 
be  reduced  to  the  same  level  that  the  student  will  find  on  the  job. 

8.  Provide  plenty  of  opportunities  for  students  to  practice  making 
recognitions  of  each  pattern  being  learned. 

9.  In  practice  and  practice  tests,  provide  for  immediate  knowledge  of 
results  to  help  the  student  meet  the  learning  objectives  by  making 
each  action  of  the  task  correct. 

10.  The  pause  following  knowledge  of  results  should  be  long  enough  to 
allow  the  student  time  to  sort  out  his  errors  and  pick  out  distinctive 
features  of  the  pattern  to  be  classified. 

11.  Provide  the  student  with  practice  in  recognizing  examples  from  the 
full  range  of  patterns  produced  by  a given  object.  Make  the  examples 
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more  similar  as  training  progresses.  At  the  end  of  training,  the 
similarities  in  the  examples  should  be  the  similarities  that  exist 
In  the  real  world. 

12.  Provide  a variety  of  examples  of  the  pattern  - select  examples  from 
the  full  range  of  variations  In  the  pattern.  Late  In  the  learning 
stage,  include  distractions  and  false  cues  that  might  be  found  in  the 
job  setting. 

13.  Different  trainees  will  have  different  rates  and  styles  of  learning 
the  material.  Try  to  provide  flexibility  in  the  time  allowed. 

14.  In  order  for  slower  learners  to  reach  the  same  level  of  proficiency 
as  faster  learners,  time  must  be  allowed  for  the  slower  learner  to 
get  as  many  or  more  positive  rewards  for  correct  answers  as  the 
faster  1 earner. 

15.  Be  sure  that  students  develop  a strong  tendency  to  look  for  certain 
critical  and  distinctive  pattern  and  develop  the  same  kind  of 
expectations  they  will  need  to  have  while  on  the  job. 

16.  To  test  learning,  require  the  trainee  to  provide  new  examples  of 

the  pattern,  and  to  teach  recognition  of  the  pattern  to  someone  else. 

17.  Require  the  student  to  over  I earn  the  original  material;  that  is,  the 
student  should  continue  to  practice  the  required  tasks  after  the 
point  that  simple  mastery  of  the  task  has  been  met.  Reduce  forgetting 
by  providing  periodic  opportunity  to  recall  and  apply  infrequently 


used  material 
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SUB-CATEGORY  3:  IDENTIFYING  SYMBOLS 


1.  Clearly  relate  the  learning  objectives  and  learning  activities  to 
operational  tasks,  which  the  trainee  must  perform  in  future  real 
world  assignments. 

2.  If  there  are  very  similar  symbols  or  features  of  parts  of  symbols 
which  have  been  frequently  confused  in  the  past,  then  be  sure  that 
the  students  can  tell  the  difference  between  the  symbols  or  foatur»:-v 
of  parts  of  synbols  before  they  are  taught  actions  to  take  for  each 
one  (predifferentiation  of  stimuli). 

3.  Break  the  overall  learning  task  down  into  manageable  steps  or  units 
when  any  of  the  following  conditions  exist: 

a.  lower  ability  students 

b.  complex  material 

c.  overall  task  contains  many  small  parts 

The  size  of  the  set  will  depend  upon  the  extent  that  the  above 
conditions  will  be  different  from  the  normal  conditions. 

4.  During  instruction,  the  presentation  of  the  symbol  should  be 
followed  immediately  by  the  presentation  of  its  meaning  (contiguity), 

5.  Change  the  order  of  presenting  the  material  during  practice  so  that 
each  item  in  the  list  will  be  learned  equally  well  and  insure  that 
the  symbol  and  its  meaning  will  appear  together  in  the  list  to  be 
learned. 

6.  When  possible,  supply  students  with  diagrams,  pictures,  charts, 


graphs,  rhymes,  acronyms,  key  words,  and  other  association  devices 
(mnemonics)  to  which  the  student  can  relate  what  he  is  try'  j 
to  learn.  Also  encourage  the  students  to  make  up  their  own 
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association  devices  If  they  can  and  want  to.  Pick  out  features 
of  the  real  world  job  environment  which  could  be  used  to  spark 
the  trainees'  recall  of  associated  material  which  would  likely 
be  used  In  that  part  of  this  job.  When  possible,  provide  the 
students  with  association  devices  which  will  cause  an  emotional 
reaction  In  the  student. 

7.  Allow  for  self-paced  practice  and  provide  the  student  with  knowledge 
of  the  results  of  his  identifications. 

8.  Reduce  forgetting  by  providing  periodic  recall  and  practice  for 
Infrequently  used  material.  Require  the  student  to  overlearn  the 
original  material:  that  is,  the  student  should  continue  to  practice 
the  required  tasks  after  the  point  that  simple  mastery  of  the  task 
has  been  met. 

9.  Practice  and  test  situations  should  require  the  student  to  make 
written  or  verbal  answers  so  that  the  accuracy  of  his  recall  can 
be  checked. 

10.  Different  trainees  will  have  different  rates  and  styles  of  learning 
the  material.  Try  to  provide  flexibility  in  learning  time. 

11.  Positive  reward  of  the  student's  correct  identification  of  symbols 
and  provision  of  immediate  knowledge  of  result  Is  required  in  the 
early  stages  of  training.  Toward  the  end  of  training,  the  level  of 

i 

positive  rewards  and  knowledge  of  results  should  be  reduced  to  the  * j 

same  level  that  the  student  will  find  on  the  job.  ; 
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SUB-CATEGORY  4:  DETECTING 


1 
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1.  At  the  beginning  of  the  training,  the  Instructor  or  the  materials 
should  clearly  Inform  the  trainee  of  the  learning  objectives;  that 
Is,  what  the  trainee  Is  expected  to  be  able  to  do  by  the  completion 
of  training.  Relate  the  learning  objectives  and  learning  activities 
to  operational  tasks  which  the  trainee  must  perform  In  future  real 
world  assignments. 

d.  Train  student  to  use  systematic  overall  search  procedures  utilizing 
whatever  senses  (sight,  hearing,  etc.)  are  appropriate  for  the  task. 
Provide  examples  of  correct  performance  of  the  task  where  appropriate. 

3.  In  presenting  signals,  sample  from  the  full  range  of  types  of  signals. 
Include  the  different  signal  sources  to  be  encountered  on  the  job 

and  the  different  patterns  of  each  signal  source. 

4.  Train  the  student  In  techniques  of  vigilance: 

a.  train  him  to  establish  a mental  "set**  to  search.  Use  Instructions 
to  establish  this  "set"  and  provide  a positive  reward  when  the 
student  achieves  a proper  "set." 

b.  train  the  student  to  monitor  his  own  vigilance  level  by 
conditioning  him  to  respond  to  biological  conditions  (internal 
cues)  which  appear  when  vigilance  begins  to  fade. 

c.  where  appropriate,  train  the  student  to  use  peripheral  vision 
when  scanning  with  the  eyes. 

5.  Train  the  student  In  detection  skills  according  to  the  following 
schedule: 

a.  Early  in  training: 


1)  provide  a high  signal  density  - more  frequent  than  in 
operational  task 
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2)  signals  should  have  high  slgnal-to-nolse  ratio 

3)  use  different  amounts  of  time  between  signal  presentations 

4)  insure  a high  frequency  of  student  identifications  of  the 

signal 

5)  provide  student  with  immediate  and  continuous  knowledge  of 

results 

6)  do  not  teach  any  vigilance  techniques 

b.  During  intermediate  stage  of  training: 

1)  use  a lower  signal  density 

2)  use  lower  slgnal-to-noise  ratios 

3)  use  different  amounts  of  time  between  signal  presentations 

4)  provide  student  with  intermittent  knowledge  of  results 

5)  Introduce  vigilance  technio*»es 

c.  In  advanced  stage  of  training: 

1)  low  signal  density;  i.e.,  operational  density  or  minimum 
number  suited  to  training 

?)  decrease  signal-to-noise  ratio  to  operational  level 

3)  use  different  amounts  of  time  between  signal  presentations 

4)  provide  the  student  with  knowledge  of  results  equivalent 

to  what  he  will  receive  on  the  job 

5)  require  vigilance  techniques  appropriate  to  the  job  setting 
Where  it  is  possible  for  the  signal  to  be  detected  by  more  than  one 
sense,  and  when  a student  thinks  he  has  detected  the  signal  through 
one  sense,  train  the  student  to  use  the  detected  signal  as  a cue  to 
search  for  and  verity  the  existence  of  the  signal  in  a second  sense 
modality. 


7.  Providing  knowledge  of  results  on  correct  detections  can  serve  as 
positive  reward  to  encourage  vigilance  behaviors  that  will  lead 
to  continued  correct  detections. 

8.  Ensure  that  detections  are  correct  before  providing  positive 
reward. 

9.  Do  not  allow  a student  to  leave  one  phase  or  level  of  the  learning 
task  until  he  has  achieved  the  required  level  of  mastery. 
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SUB -CATEGORY  5:  MAKING  DECISIONS 

1.  At  the  beginning  of  the  training,  the  Instructor  or  the  materials 
should  clearly  Inform  the  trainee  of  the  learning  objectives;  that 
Is,  what  the  trainee  Is  expected  to  be  able  to  do  by  the  conpletion 
of  training.  Relate  the  learning  objectives  and  learning  activities 
to  operational  tasks  which  the  trainee  must  perform  in  future  real 
world  assignments. 

2.  For  the  most  efficient  learning  of  decision  making  tne  student 
must  already  have  learned  the  technical  knowledge  which  will 
allow  him  to: 

a.  identify  what  the  problem  really  is 

b.  make  a list  of  the  most  reasonable  solutions 

c.  determine  which  of  the  solutions  would  be  best 

3.  The  student  will  learn  best  If  he  is  not  afraid  of  making  Incorrect 
decisions  in  the  training  situations;  this  is  particularly  true  in 
the  early  stages  of  training  and  in  very  complex  decision  making 
processes.  Materials  and  instructors  should,  therefore,  attempt 

to  decrease  student  fears  to  a low  levs!. 

4.  Give  the  students  examples  of  these  two  types  of  actions  which  are 
to  be  avoided  when  making  decision: 

a.  response  biases;  that  is,  the  tendency  to  make  a ’favorite" 
decision  or  use  a "favorite"  solution  regardless  of  the  real 
nature  of  the  problem. 

b.  perceptual  sets;  that  is,  the  tendency  to  generalize  problems 
or  view  several  types  of  problems  as  if  they  were  all  the  same 
when,  in  fact,  they  are  quite  different. 
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5.  It  Is  useful  to  teach  the  students  a set  of  steps  to  follow  In 
making  decisions.  The  following  5-step  model  Is  suggested: 

a.  Discover  the  existence  of  a problem  and  define  it 

b.  Identify  and  collect  relevant  information 

c.  Develop  reasonable  solutions  to  the  problem 

1)  compare  alternative  solutions 

2)  combine  alternate  solutions  where  desirable 

d.  Evaluate  each  of  the  proposed  solutions. 

1)  How  will  each  solution  solve  the  problem? 

2)  Will  each  solution  bring  about  any  additional  benefits  or 

problems? 

3)  Rank  each  solution  according  to  the  results  it  would  bring. 

e.  Decide  on  the  best  solution  and  put  it  into  effect. 

6.  Be  sure  that  the  student  is  provided  with  enough  realistic  information 
and  data  on  which  to  formulate  possible  solutions  and  make  final 
decisions;  also,  be  sure  that  he  makes  decisions  In  the  same  variety 
of  settings  as  he  will  face  in  carrying  out  his  job. 

7.  Provide  the  student  with  a wide  variety  of  decision  making  experiences, 
Provide  basic  problems  where  there  are  only  a few  factors  to  consider  - 
solutions  to  these  problems  should  range  from  easy  f-o  hard.  Also 
provide  complex  problems  which  require  the  student  to  consider  many 
factors  - again,  the  solutions  should  range  from  easy  to  hard. 

8.  If  the  trainee  will  be  required  to  make  the  decision  under  stress 
in  the  real  world,  then  he  must  overleam  the  decision  making  skill 
during  training.  That  is,  he  must  be  able  to  make  the  correct 

. / 
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decision,  and, he  must  be  able  to  make  the  decision  efficiently,  accu- 
rately, and  repeatedly  In  distracting  surroundings. 

9.  During  the  final  stages  of  training,  It  Is  Important  to  provide 
situations  which  closely  duplicate  the  real  world  with  respect  to: 

a.  amount  of  data 

b.  type  of  data 

c.  amount  of  time  to  complete  the  decision  making  problens 

d.  amount  of  distraction  and  "noise"  in  the  working  environment 

10.  Provide  the  learner  with  knowledge  of  results  (KOR)  for  each 
decision  he  makes.  Here  Is  a reconwended  list  of  questions  to  ask 
about  the  learner's  problem  solutions: 

a.  Predictable?  (Were  evidences  of  perceptual  sets  shown  In  his 
solution?) 

b.  Perseverated?  (Were  evidences  of  response  biases  shown  in 
his  solution?) 

c.  Timely?  (Ts  this  the  appropriate  time  to  execute  this  particular 
decision?) 

d.  Complete?  (Did  he  consider  all  of  the  data  and  information?) 

e.  Consistent?  (Is  his  solution  compatible  and  relevant  to  the 
data  and  the  available  information?) 

Give  KOR  with  respect  to  the  above  five  criteria  each  time,  and 
where  possible,  provide  the  actual  consequences  of  the  learner's 
decision  as  compared  to  his  other  alternatives. 


SUB-CATEGORY  6:  RECALLING  BODIES  OF  KNOWLEDGE 
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1.  At  the  beginning  of  the  training,  the  Instructor  or  the  materials 
should  clearly  Inform  the  trainee  of  the  learning  objectives;  that 
Is,  what  the  trainee  is  expected  to  be  able  to  do  by  the  completion 
of  training  in  a way  that  the  trainee  will  meet  the  learning 
objectives . 

2.  Analyze  the  body  of  knowledge  to  detect  keywords  or  formulas  or 
phrases  or  whatever.  Then  organize  the  learning  activities  around 
these  key  Items. 

3.  Before  testing  for  recalling  bodies  of  knowledge,  provide  some  warm- 
up exercises  or  an  introduction  to  remind  the  student  of  the  type  of 
task  and  the  type  of  Information  he  will  need. 

4.  Make  the  learning  activities  relevant  by  making  them  similar  to 
real-life  tasks  that  the  student  will  be  performing  on  the  job. 

5.  If  it  Is  necessary  for  the  student  to  learn  similar  bodies  of  subject 
matter,  then  either  directly  compare  the  bodies  when  they  are  first 
presented  so  that  the  student  can  tell  them  apart,  or  separate  their 
presentations  by  as  much  time  as  possible  to  avoid  confusion  between 


6.  If  the  real  world  job  wi’l  present  the  trainee  very  similar  features 
of  the  situation  which  will  require  the  trainee  to  remember 
different  knowledge  for  each  feature,  then  make  sure  that  the 
trainee  learns  the  difference  between  these  features  before  he 
is  taught  which  body  of  knowledge  to  associate  with  each  feature 
(predifferentiation). 
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7.  When  possible,  provide  students  with  association  devices  which 
will  cause  an  emotional  reaction  in  the  student. 

8.  When  possible,  supply  students  with  diagrams,  pictures,  charts, 
graphs,  rhymes,  acronyms,  key  words,  and  other  association  devices 
(mnemonics)  like  these  to  which  the  student  can  relate  the  facts 
and  principles  he  is  trying  to  learn  to  help  him  recall  inore  easily. 

Also  encourage  and  give  students  directions  to  make  up  their  own 
association  devices  if  they  can  and  want  to. 

9.  Arrange  for  features  of  the  real  world  job  setting  to  be  used  to 
trigger  the  trainee's  recall  of  associated  material  which  in  turn 
will  trigger  the  knowledge  he  needs  to  do  the  job. 

10.  Try  to  use  high  interest,  attention-getting  features  of  the  learning 
materials  throughout  the  training.  One  way  to  keep  student  attention 

is  to  use  learning  activities  which  require  active  student  participation. 

11.  In  early  phases  of  training,  it  is  good  to  provide  the  student  with 
guides,  prompts,  cues,  and  coaching  which  will  help  him  remember  the 
material  correctly.  As  training  progresses,  this  kind  of  help  should 
be  reduced  until  it  matches  the  level  of  help  that  will  be  available 

- in  the  real  world  job  setting. 

12.  Provide  students  with  opportunities  to  practice  their  training  tasks 
by  setting  up  a wide  variety  of  testing  and  practice  situations  which 
are  very  similar  to  situations  the  learner  will  encounter  on  the 
job. 

13.  Practice  and  test  situations  should  require  the  student  to  make 
written  or  verbal  answers  so  that  the  accuracy  of  his  recall  of 
the  facts  ar.d  principles  he  learned  can  be  checked. 
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14.  During  the  training  sessions  provide  the  student  with  immediate 
knowledge  of  results  (KOR)  about  his  correct  and  incorrect  answers. 
Provide  positive  rewards  during  the  Instruction,  even  during 
non-testing  situations.  Reward  a student's  progress,  attitude, 
attention,  mastery  of  an  objective,  etc.  If  a student  is  rewarded 
for  working  well,  it  Is  often  more  probable  that  he  will  continue 
to  work  well . 

15.  In  practice  and  practice  tests,  provide  for  immediate  knowledge  of 
results  to  help  the  student  retain  correct  answers  and  eliminate 
incorrect  answers  in  the  most  efficient  manner. 

16.  Change  the  order  of  presenting  the  material  during  practice  so  that 
each  item  in  the  list  will  be  learned  equally  well 

17.  Rest  periods  should  be  provided  during  practice  sessions  according  to: 

a.  need  for  rest  as  judged  by  the  student 

b.  requirements  of  the  specific  learning  material  as  judged  by 
the  instructor 

18.  Different  trainees  will  have  different  rates  and  styles  of  learning 
the  material  T*y  to  provide  flexibility  in  time  to  learn. 

In  order  for  slowar  learners  to  reach  the  same  level  of  proficiency 
as  fascer  learners,  time  must  he  allowed  for  the  slower  learner  to 
gat  s many  or  oore  positive  rewards  for  correct  answers  as  the 
faster  learner. 

19.  As  training  continues,  give  the  learner  chances  to  compare  his 
progress  and  achievement  with  the  stated  learning  objectives. 

20.  Test  to  see  that  the  student  is  able  to  correctly  recall  key  features 
that  will  help  him  recall  the  knowledge  he  needs  in  performing 
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his  job.  If  not,  provide  more  practice  in  associating  the  knowledge 
to  be  learned  with  these  key  features  of  the  job  setting. 

21.  Help  prevent  forgetting  by: 

a.  increasing  the  meaningfulness  of  the  material  by  relating  it 

to  the  learner's  job  environment  and  duties  and  by  emphasizing  the 
organization  and  structure  of  the  material. 

b.  requiring  the  student  to  overlearn  the  original  material;  that 
is,  the  student  should  continue  to  practice  the  required  tasks 
after  the  point  that  simple  mastery  of  the  training  cask  has 
been  met. 
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SUB-CATEGORY  7:  PERFORMING  GROSS  MOTOR  SKILLS 

1.  At  the  beginning  of  the  training,  the  Instructor  or  the  matedals 
should  cleanly  Inform  the  trainee  of  the  learning  objectives. 

Relate  the  learning  objectives  and  learning  activities  to 
operational  tasks  which  tie  trainee  must  per.orm  in  future  real 
world  assignments. 

2.  Teach  the  learner  to  tell  the  difference  between 

a.  simi I ar  external  cues  (conditions,  features,  characteristics,  etc. 
of  objects  In  the  job  environment  to  which  the  learner  must  respond 
with  an  appropriate  action)  like  knowing  when  too  much  pressure 

is  put  on  a power  saw  the  wood  begins  to  smoke. 

b.  similar  internal  cues  (muscular  feelings  inside  one's  body  which 
guide  the  execution  of  a physical  skill  and  allow  automatic 
responses)  like  knowing  by  the  "feel"  of  the  power  saw  how  much 
pressure  to  use  without  burning  the  wood. 

3.  Different  things  should  be  emphasized  in  different  stages  of  training: 

a.  early  in  training 

1)  present  immediate  and  specific  knowledge  of  results  to  the 

student 

2)  present  external  cues  that  will  bring  out  the  desired  responses 

in  the  student's  actions 

b.  later  in  training 

1)  reduce  the  knowledge  of  results  to  on-the-job  levels 

2)  train  the  student  to  respond  to  Internal  cues  in  his  muscles 

to  guide  his  actions  in  correctly  performing  the  task 


54 

4.  If  students  make  Incorrect  actions  or  beoln  to  develop  bad  habits, 
present  a penalty  following  these  Improper  responses  until  they 
disappear. 

5.  Insure  that  the  learner  understands  the  tasks  by  requiring  him  to 
do  the  following: 

a.  observe  a correct  performance  of  the  task 

b.  observe  the  component  parts  of  the  task  being  presented 

c.  have  student  describe  and  demonstrate  the  component  parts 
of  the  desired  task 

6.  Require  that  the  learner  practice  with  regard  to  the  following 
considerations: 

a.  practice  on  parts  (specific  components)  of  the  task: 

1)  simple  task-practice  in  entirety 

2)  complex  task  practice  In  parts  and  then  In  entirety 

b.  practice  under  varied  conditions.  This  is  done  to: 

1)  facilitate  the  performance  of  the  motor  task 

2)  help  adapt  the  performance  of  this  task  to  potential 

environmental  changes 

c.  ensure  that  during  practice  the  learners: 

1)  understand  the  objectives  of  the  $'<111  while  learning 

2)  observe  a skilled  performance  of  the  desired  task  as  often 

as  necessary 

3)  obtain  knowledge  of  results  concerning  his  performance  of 

the  task 

d.  have  short  rest  periods  mixed  in  with  the  practice  periods 
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7.  Give  knowledge  of  results  of  the  following  kinds: 

a,  evaluative-student  learns: 

1)  what  he  Is  doing  right 

2)  what  he  is  doing  wrong 

b.  comparative- -student  learns  how  what  he  did  compares  to  the: 

1)  learning  objectives  of  the  program 

2)  correct  demonstration  of  task 

3)  standards  that  are  required  in  operational  setting 

8.  The  pause  following  knowledge  of  results  should  be  longer  than 
the  time  between  the  action  and  the  knowledge  of  results  to 
allow  the  student  time  to  sort  out  his  errors  and  to  rest  his 
muscles. 

9.  Reward  performances  which  are  closer  to  the  goal  than  the  preceeding 
performances.  In  this  manner,  the  student's  performance  will  become 
successively  closer  to  the  desired  performance  (shaping).  After 
the  student  successfully  reaches  the  desired  performance,  reduce 
the  frequency  of  reward  to  the  level  found  on  the  job, 

10.  Require  the  student  to  overleam  the  original  material;  that  is, 
the  student  should  continue  to  perform  the  required  tasks  after  the 
point  that  simple  mastery  of  the  task  has  been  met. 

11.  Increase  distractions,  interruptions,  and  "noise"  to  the  level  that 
the  person  will  encounter  on-the-job  (where  appropriate) . 

12.  Allow  for  individual  variation  in  physical  coordination  and  provide 
extra  time  and  practice  for  those  who  learn  the  skills  less  readily. 

13.  Reduce  forgetting  by  providing  periodic  practice  for  infrequently 
used  skills. 


mUiuuMl unllDMtthi 


56 

SUB-CATEGORY  8:  STEERING  ANQ  GUIDING  - CONTINUOUS  MOVEMENT 
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1.  At  the  beginning  of  the  training,  the  instructor  or  the  materials 
should  clearly  inform  the  trainee  of  the  learning  objectives. 

Relate  the  learning  objectives  and  activities  to  operational  tasks 
which  the  trainee  must  perform  in  future  real  world  assignments. 
Provide  a preview  of  important,  selected  motions  and  movements 
that  the  student  will  learn  to  make. 

2.  Break  the  overall  learning  task  down  into  manageable  steps  or  units 
when  any  of  the  following  conditions  exist: 

a.  lower  ability  students 

b.  complex  material 

the  overall  task  contains  many  small  parts  and  is  so  long  that 

the  student  or  Instructor  thinks  that  only  a part  of  It  at  a 

time  should  be  learned, 

3.  Ensure  that  the  critical  cues  from  which  the  trainee  must  get  his 
information  for  correctly  performing  the  task  are  realistic  and 
continually  available  during  the  performance  of  the  task. 

4.  Teach  the  student  to  scan  continuously  by  specific  training  of  eye 
movement  and  where  to  focus  for  scanning. 

5.  In  continuous  control  task  training,  a high  relationship  to  real- 
world  conditions  is  required  In: 

a.  the  presentation  of  the  cues  to  which  the  trainee  must  react 

b.  the  actions  and  reactions  which  the  trainee  makes 

c.  the  way  that  the  displays  and  controls  of  the  system 
continuously  respond  to  the  trainee's  control 
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6.  Demonstrate  correct  task  performance  with  a model. 

7.  Highly  skilled  performance  requires  extensive  practice.  This 
practice  should  contain: 

a.  understanding  of  skill  objectives 

b.  observe  skill  performances 

c.  practice  task 

d.  receive  knowledge  of  results 

e.  allow  rest  periods  to  be  mixed  in  with  the 
(distributed  practice)  practice  periods  when  the 
trainee  feels  that  he  needs  them. 

8.  Positive  reward  should  be  provided  for  performances  which  are 
closer  to  goal  than  proceeding  performances.  In  this  manner, 
the  student's  performance  will  become  successively  closer  to  the 
desired  performance  (shaping). 

9.  Give  the  student  knowledge  of  results  on  small,  distinct  segments 
of  his  performance,  especially  during  early  stages  of  learning. 

10.  Positive  reward  should  follow  as  soon  as  possible  after  each 
correct  student  performance,  initially  after  each  distinct  segment 
of  performance  and  toward  the  end  of  training  after  each  maneuver 
or  complete  evolution. 

11.  Practice  on  specific  component  skills  when  learning  complex  tasks. 

12.  Practice  under  a variety  of  conditions. 
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SUB-CATEGORY  9:  POSITIONING  MOVEMENT  AND  RECALLING  PROCEDURES 

1.  At  the  beginning  of  the  training,  the  Instructor  or  the  materials 
should  clearly  Inform  the  trainee  cf  the  learning  objectives. 

Organize  the  training  material  in  such  a way  that  the  trainee 

can  easily  Identify  and  achieve  the  learning  objectives  throughout 
the  training.  Relate  the  objectives  and  learning  activities 
to  operational  tasks  which  the  trainee  must  perform  in  future  real 
world  assignments. 

2.  Break  the  physical  skills  (positioning  movement)  Into  logical  sub- 
units or  part  skills.  Then  make  sure  that  the  procedural  steps 
for  each  of  these  sub-units  are  well  organized. 

3.  Break  the  overall  learning  task  down  into  manageable  steps  or  units 
when  y of  the  following  conditions  exist: 

a.  lower  ability  students 

b.  complex  material 

c.  overall  task  contains  many  small  parts 

4.  Provide  a visual  demonstration  of  the  physical  skill  that  the  trainee 
is  expected  to  perform  at  each  step  in  the  checklist  of  procedures. 

5.  If  the  checklist  presents  the  trainee  with  similar  checklist  items 
which  in  the  past  have  been  frequently  confused,  then  be  sure 
that  the  trainee  can  explain  the  differences  between  these  similar 
checklist  items  before  he  is  taught  which  action  to  take  for  each  one. 

6.  When  possible,  supply  students  with  diagrams,  pictures,  charts, 
graphs,  rhymes , acronyms , key  words,  and  other  association  devices 


(mnemonics)  like  these  to  which  the  student  can  relate  the  material 
he  Is  trying  to  learn.  Also  encourage  students  to  make  up  their  own 
association  devices  If  thoy  can  and  want  to. 


7.  Wien  possible,  provide  students  with  association  devices  which  will 

" cause  an  emotional  reaction  In  the  student, 

8.  To  help  students  remember  a chain  of  procedures,  it  is  useful  to 

* practice: 

a.  identifying  each  checklist  item  and  explaining  or  performing 
its  corresponding  procedure 

b.  Identifying  a group  of  checklist  items  (as  many  as  the  student 
can  handle  at  once)  and  explaining  or  performing  their 
corresponding  procedural  steps  - the  first  item?  of  each  group 
should  overlap  with  the  last  Items  of  the  previously  studied 
group 

c.  identifying  all  of  the  checklist  Items  and  explaining  or 
performing  their  corresponding  procedural  steps 

9.  Help  students  to  use  association  devices  that  are  easily  changed 
into  a form  that  is  easier  to  remember  to  aid  in  the  recall  of 
procedures,  then  encourage  students  to  mentally  practice  running 
through  the  steps  In  the  checklist. 

10.  Ensure  that  the  trainee  has  a lot  of  opportunity  to  practice  the 
physical  skills  early  in  the  training.  These  five  steps  provide  a 
good  outline  for  practice: 

a.  be  sure  the  trainee  understands  the  learning  objectives 

l 

i b.  provide  a visual  demonstration  of  the  correct  performance 
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c.  allow  the  trainee  to  practice  part-skills  and  provide  feedback 
to  train  him  to  perfect  the  movement. 

d.  integrate  the  part-skills  into  a smooth  sequence 

e.  provide  feedback  so  the  trainee  can  Improve  his  performance 

11.  The  following  conditions  should  be  provided  In  earlier  and  later 
stages  of  training: 

a.  Earlier  stages  of  training 

1)  immediate  and  frequent  knowledge  of  results 

2)  Immediate  and  frequent  positive  reward 

3)  few  or  no  distractions 

4)  learning  material  broken  down  into  small,  easily  learned  parts 

5)  items  are  relatively  easy  to  learn 

6)  provide  guides,  prompts,  cues,  and  coaching  to  aid  learning 
. Later  stages  of  training 

1)  occasional,  delayed  feedback 

2)  occasional,  delayed  reward  of  students'  correct  movements 

3)  distractions  and  interferance  are  similar  to  what  will  be 

found  on  the  job 

4)  learning  material  to  be  recalled  and  used  as  it  would  be  on 

the  job 

5)  the  material  should  be  as  complex  as  chat  to  be  used  on  the  job 

6)  add  the  amount  of  distractions  that  would  be  found  on  the  job 

7)  use  no  guides  or  prompts  that  would  not  be  found  on  the  job 

12.  Positive  reward  should  follow  as  soon  as  possible  after  a correct 


answer. 


I. 


I 

I 

t 

! 

f. 


61 

13.  The  pause  fol lowing  knowledge  of  results  should  be  long  enough  to 
allow  the  student  time  to  sort  out  his  errors  or  mentally  confirm 
his  correct  answer  (post-feedback  dalay). 

14.  Pick  out  features  of  the  real  world  job  envlroment  which  could  be 
used  to  spark  the  trainees'  recall  of  associated  material  which 
must  be  used  In  that  part  of  his  job.  Actual  parts  of  the  material 
being  learned  can  sometimes  be  used  to  spark  the  student's  recall 
of  other  parts  of  the  material. 

15.  Rest  periods  should  be  provided  during  practice  sessions  according  to: 

a.  need  for  rest  as  judged  by  the  student 

b.  requirements  of  the  specific  learning  material  as  judged 
by  the  instructor 

16.  These  types  of  tasks  should  be  overleamed  through  extensive  practice. 
Often  just  doing  one  step  in  a procedure  or  activity  will  auto- 
matically remind  ono  of  what  step  comes  next. 

17.  In  order  for  slower  learners  to  reach  the  same  level  of  proficiency 
as  faster  learners,  time  must  be  allowed  for  the  slower  learner  to 
get  as  many  or  more  positive  rewards  for  correct  answers  as  the 
faster  learner. 

18.  Two  guidelines  on  the  amount  of  realism  required  for  procedural 
and  physical  skill  practice  are: 

a.  equipment  realism  can  be  at  a minimum  level;  for  example,  a 
photo  of  the  job  setting  or  a paper  and  plywood  model 
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b.  checklist  Items  and  their  corresponding  procedural  responses 
need  to  be  as  realistic  as  possible 
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19.  As  training  continues,  occasionally  give  the  learner  chances  to 
compare  his  progress  and  achievement  with  the  stated  course 
objectives. 

20.  Train  the  student  to  the  level  of  proficiency  required  on  the  job. 
Facilitate  acquisition  of  the  material  by  relating  it  to  on-the-job 
duties,  responsibilities,  advancement,  or  survival. 

21.  Reduce  forgetting  by  providing  periodic  practice  for  infrequently 
used  procedures. 
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SUB-CATEGORY  10:  VOICE  COMMUNICATING 


1.  At  the  beginning  of  +he  training,  the  Instructor  or  the  materials 
should  clearly  inform  the  trainee  of  the  learning  objectives. 

Organize  the  training  material  in  such  a way  that  the  trainee  can 
easily  identify  and  meet  the  learning  objectives.  Relate  the 
lemming  objectives  and  activities  to  operational  tasks  which  the 
trainee  must  perform  in  future  real  world  assignments. 

2.  Present  a brief  overview  of  the  activities  in  which  the  students 
will  participate  during  training. 

3.  Break  up  the  material  Into  separate,  distinc. !.e  types  of  voice 
communication  that  appear  on  the  job. 

4.  Identify  similar  cues  (sounds , words,  groups  of  words,  vocal  patterns, 
etc.)  that  are  often  confused  in  communications  of  this  type  and  test 
the  student  to  be  sure  that  he  con  tell  the  difference  between  them. 

5.  Point  out  critical  cues  and  performances  that  are  different  from 
habitual  (everyday  type)  voice  coirmunicacion. 

6.  Teach  the  student  in  be  mentally  alert  for  the  specific  voice 
cowjni cations  being  taught;  that  is,  teach  the  student  to  listen 
for  certain  words  and  phrases  (perceptual  set). 

7.  Before  demonstrating  specific  procedures  and  techniques,  teach 
general  voice  communication  terminology  and  procedure  (see  "recalling 
bodies  of  knowledge"  for  this). 

8.  Demonstrate  a given  voice  procedure  with  examples  of  correct  , „-r- 
fonmance.  Be  sure  the  leame*-  observes  critical  cues  and  the 
appropriate  responses  that  he  should  make  to  them. 
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9.  Require  enough  practice  trials  of  the  learner  to  produce  the 
correct  performance;  he  should  especially  practice  parts  he  is 
having  difficulty  with  until  he  can  demonrtrate  t.he  co“rect 
procedure, 

10.  During  practice,  practical  applications,  anti  practice  tests,  p'-ovide 
the  student  with  inmediate  knowledge  of  results  about  his  correct 
and  incorrect  answers.  Positive  reward  should  follow  as  scon  as 
possible  after  a correct  answer. 

11.  Rest  periods  should  be  provided  during  practice  sessions  (distributed 
practice)  according  to: 

a.  need  for  rest  as  judged  by  the  student 

b.  raqui reinents  of  the  specific  learning  material  as  judged  by 
the  instructor. 

12.  Tow* "d  the  end  of  training,  increase  stress  and  miscellaneous 
interruptions,  distractions,  and  "noise"  to  the  level  that  will 
a;  oar  on  the  job. 

13.  Practice  voice  communication  procedures  to  tie  level  that  they  will 
have  to  be  performed  in  the  job  setting;  this  may  require  some 
practice  in  team  training  with  voice  communication. 

14.  Cross  train  the  learner  so  that  he  msy  perform  other  voice  communi- 
cation tasks  so  that  he  may  act  as  a replacement  for  other  members 
of  his  team. 

15.  Require  the  student  to  overlearn  the  original  material;  that  Is, 
the  student  should  continue  to  practice  the  reqiired  tasks  after 
the  point  that  simple  mastery  of  the  task  has  ! ei  n met. 
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16.  Reduce  forgetting  by  providing  periodic  practice  for  infrequently 
used  material. 

17.  Provide  a large  reward  when  trainee  meets  overall  training  objectives 
and  required  overlearning. 


if"'-,  ‘ ' ' IK  
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SUB-CATEGW  11:  ATTITUDE  LEARNING 

There  are  three  separate  components  of  an  attitude  that  must  be 
dealt  with  separately.  They  are:  (A)  the  affective  component  (feeling, 
emotion),  (B)  the  cognitive  component  (perception,  knowledge,  Information) , 
and  (C)  the  behavioral  component  (responses,  acts,  deeds).  The  learning 
guidelines  will  be  separated  Into  groups  that  support  each  of  these 
components.  It  Is  important  to  know  that  there  are  recognized  alter- 
native ways  of  achieving  each  component,  so  the  guidelines  should  be  used 
as  a menu  from  which  you  choose  appropriate  items  for  each  of  the  three 
groups.  It  is  usually  unnecessary  and  impractical  to  use  all  of  the 
guidelines  in  a group.  The  more  powerful  guidelines  are  listed  last  in 
each  section. 

A.  Affective  Component  - to  produce  in  the  student  the  desired 
feelings  and  emotions 

1.  Attempt  to  get  the  student  to  identify  with  a group  of 
people  which  has  the  desired  attitude  as  a group  norm. 

(The  majority  of  the  people  already  believe  it.) 
a.  Persuade  him  of  the  desirability  of  belonging  to 
such  a group. 

0.  Reward  him  for  affiliating  and  identifying  with  such 
a.  group. 

c.  When  appropriate,  punish  him  when  he  shows  identification 
with  a group  riot  holding  the  desired  attitude  as  a group 


norm. 
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d.  Show  desirability  of  belonging  to  such  a group  by 
establishing  that: 

1)  those  he  likes , respects,  and  wants  to  associate 
with,  aleady  belong  to  such  a group  (If  possible) 

*.  2)  those  who  belong  to  such  a group  receive  rewards 

and  have  a reduction  in  anxiety  level  (don't  have 
r to  live  in  fear  of  doing  the  wrong  thing) 

2.  Provide  positive  rewards  to  the  student  only  when  he 
displays  his  closest  approximation  of  the  attitude 

or  displays  the  exact  attitude.  Punish  demonstrations  of 
incompatible,  undesirable  attitudes. 

3.  Use  social  learning  (imitation)  of  respected  people  to 
train  the  student  to  adopt  the  desired  attitude.  Do  this 
by  demonstrating: 

a.  people  the  student  likes,  respects,. or  wants  to  assoc- 
iate with  being  rewarded  after  a behavior  that  resulted 
from  showing  tha  desired  attitude. 

b.  people  the  student  likes,  respects,  or  wants  to  assoc- 
iate with  being  punished  following  a behavior  that 
was  incompatible  with  having  desired  attitudes. 

B.  Cognitive  Component  - to  produce  the  perceptions,  knowledge,  and 
information  necessary  for  the  desired  attitude 
1.  Repeatedly  present  to  the  student  a description  of  the 


desired  attitude  or  behavior  until  the  person  adopts  or 
carries  out  this  desired  attitude. 


2.  Communicate  to  the  student  the  fact  that  the  beliefs  of 


his  associates  or  Important  groups  of  people  or  authority 
figures  differ  from  his  own  initial  beliefs  about  the 
desired  attitude.  Continue  to  present  this  type  of  infor- 
mation until  the  student  makes  the  appropriate  change  in 
attitude. 

3.  Produce  uncertainty  within  the  subject  about  his  beliefs 
by  identifying  contradictions  between  two  or  more  of  the 
beliefs  which  he  holds. 

4.  Ensure  that  other  members  of  the  group  of  people  with  whom 
the  student  studies,  socializes,  and  lives,  present  specific 
arguments  for  the  cognitive  components  of  the  desired 
attitude,  and  counterarguments  tailored  to  meet  the  student's 
objections  to  the  desired  attitude. 

5.  Present  a previously  prepared  message  to  the  student 
presenting  arguments  why  he  should  adopt  the  cognitive 
component  of  the  desired  attitude.  Some  of  the  guidelines 
to  be  observed  concern: 

a.  the  characteristics  of  the  person  presenting  the 
message: 

1)  he  has  high  credibility  because  he  is  an  expert 
(knows  correct  stand  on  issue,  desired  attitude) 
and  because  he  is  trustworthy  (comnuni cates  know- 
ledge without  showing  prejudices) 

2)  initially  in  his  message,  the  persuader  appears 
highly  creditable  by  expressing  views  already  held 
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by  the  student  on  subjects  that  may  not  even  be 


relevant  to  the  attitude  being  taught 

3)  asks  for  a large  change  in  subjects  attitude 

(bigger  than  he  really  thinks  the  person  will  change) 


b.  how  the  Issue  should  be  presented: 


1)  provide  few  (if  any)  reasons  for  engaging  in  behaviors 


incompatible  with  the  desired  attitude 


2)  only  use  fear  as  a means  of  turning  students  away 


from  undesirable  attitudes  when  the  behaviors 


produced  by  the  desired  attitude  are  easy  to  describe 


and  perform 


3)  present  only  one  side  of  the  argument  when: 

a)  the  audience  is  generally  friendly 

b)  only  an  Immediate,  temporary  attitude  change 


is  desired 


4)  present  both  sides  of  the  argument  when: 


a)  the  student  starts  out  disagreeing  with  the 


desired  attitude 


b)  it  is  likely  that  the  person  will  hear  the 


other  side  anyway 


5)  when  opposite  views  are  presented  one  after  another, 


the  one  presented  last  will  be  more  effective  for 


attitude  change 


1 


6)  explicitly  state  conclusions,  except  when  the 
student  is  rather  intelligent 


7.  Intensively  Indoctrinate  the  student  by  using  a combination 
of  approaches  Including: 

a.  frequent  repetitions  of  the  descriptions  of  the 
attitude 

b.  communications  about  the  average  beliefs  of  the 
student's  friends  and  associates 

c.  tailored  arguments  to  counter  student’s  resistance 
to  change 

d.  prepared  arguments  attributed  to  a highly  respected 
person  or  group  of  people 

Behavioral  Component  - to  develop  the  responses,  actions,  deeds, 
and  performance  related  to  the  desired  attitude 

1.  Require  the  student  to  “act  out"  the  behavioral  aspect  of 
the  attitude  by  either  role  playing  or  performing  he 
desired  behavior  in  the  job  setting. 

2.  Encourage  the  student  to  publicly  announce  his  belief 
in  and  allegiance  to  the  desired  attitude,  In  front  of 
his  work-mates  and  associates. 

3.  Provide  positive  rewards  for  any  behavior  tnat  seems  to 
be  a product  of  or  Is  In  conformance  with  the  desired 
attitude.  Reinforcement  will  provide  the  desired  feedback. 
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lifted  to  that  expected  In 
the  real  uorld  situations  in 
*Mch  the  student  wl'l  be 
working . 

• satisfies  the  overall  criteria 

for  decision  strategy 

• satisfies  overlearning  / 

criteria  / 


^ Mas  X 
criterion 
performance  been 
v achieved? 


Reinforcement 


Present 
status  to  1 
student 


SU8-CA1E60RY  5:  MAKING  DECISIONS  (Con't) 


U9 


SULI- CATEGORY  6:  RECAi ! INf,  301MES  Of  KliMLCIKE 


( Con  1 1 ) 


r"'-' 


'A 


i ii  a iiiimijiuwwjflttf.iwi. 


m 
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>Ute: 

• Objectives 

• Jr^an  nation  of  program 

• Type  of  assessment 

• Relevance  to  operational 
sett  1 no 


yo-  w,,1.  ^ 
criterion 

\u!1/ 


Criterion  for  dividing  tJU  " 
into  port).  Smaller  ports 
ora  appropriate  for: 

• Students  Milk  inm* 

f i Ur 

• Higher  complexity  tasks 

• longer  to  ski  i 


Rres»nt  overview  of  the  entire  maneuver 

• Identify  the  ports  that  win  bo 
practiced  separately 

• Identify  scanning  requirements 
Demons  tfate  maneuver  using  nod# l of 
performance  including  scan. 


Select  first/next  port  of  the  maneuver 


f re sent  specific  objectives  for  this 
port  of  the  «*n*uv#r.  Test  for 
understanding. 


/ Does 
r Student 
Understand 
V ? > 


• Describe  the  skill  to  be  performed 
including  *rtOr  act,  ;CJn  patter* 
onl  focus. 

• Oer^notrote  skilled  performance. 

• Direct  student  to  practice  the 
port  of  the  wweuver. 


Student  attempts  to  «otch 
skilled  performance  of 
rode  I , including  rotor  acts, 
scon  on^  fpcgj. 


Practice  environment  s<tould 

Include: 

• realistic  critical  stimulus 
Cues,  continuously  available 
during  performance  Of  task. 

• opportunity  for  high  fidelity 
operator  response. 

• dynamic  system  behavior  - 
the  evolving  dlsplay*contro1 
relationship. 


S MJ*  X 

Student 

(net  criterion 
for  this 

\T/ 


Use  shaping  technique: 

• criterion  for  any  specific  trial 
is  based  on  the  degi .e  of  success 
achieved  on  previous  trials. 

• Reinforcement  should  be  contingent 
upon  the  student  making  a response 
that  is  an  increment  closer  in 
approximation  to  the  desired 
response. 


Reinforcement  1 


S US -CATEGORY  8:  STEERING  AND  GU 10  MG -CONTINUOUS  MOVEMENT  (Can't) 


o 


Infom  Student  out  win  AO* 
practice  the  *nt >r#  narrower . 


Present  OtjtCtivM 
*»r  Maneuver.  Test 
for  unaer standing. 


Understand 


• Jncrfli*  iM 111  U M p*.  fon*d 
lueludloj  wtor  Mtl,  IC*<*  pitUrm, 
ind  fixui. 

ftOtaOMtrlt*  Ihllltd  ptrforMKM. 

• Olrtct  ttudvM  to  prKtlc*  U* 
UMMWr, 

— I 

I Student  perform  i 


Practice  environment  4hou1d 
Include: 

• realistic  critical  stiaului 
««•**  continuously  available 

during  performance  Of  UU 

• opportunity  for  high 
fidelity  operator  response. 

• dynamic  sy:tee>  behavior  - 
the  evolving  display* 
control  relationship. 

• practice  under  varied 
conditions. 


/ Has  \ 
Student 
■et  criterion 
In  this 

vtv 


Use  shaping 
technlQue 


Reinforcement 


^ Has  X 

student  s 

net 

terminal 
criterion?  A 


Criterion  described  In  *en«s  of: 

• smoothness  of  movement. 

• magnitude  of  eicurslons  from 
optimum  path. 

• percentage  of  tlm  within 
tolerances. 


SUB-CATEGORY  8:  STEERI.1G  MO  GUIOIHG-CtttHNUOUS  ItOVEMEilT  (Con't) 
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Display  check) tit  Han. 

Student  o6ir««s  demonstration 
»*(h  « ti*ual  taodrl  : 

• Stop 

• fe1*r*ft<#i 

• Out  0<  tolerance  d tton 

• Hole-  behavto r 


Mote:  The  equipment  that  this  procedure  1« 
demonstrates  on  doesn't  Mrt  to  b*  highly 
reel  latlc , but  the  human  model's  r«ipomtt 
to  tOU  section  do  a eed  to  correspond  to 
Optra t tonal  responses  (1#) 


Arc 

merory  aids 
required? 


Present  ronory 
i ids ; 

• Mediators 

• 1C1 

{with  motional 
Allocation 
if  possible) 


/ Oo«  \ 
r student  ^ 
want  to  develop 
own  mor,  y 
\ aids?  / 


Present  Uit  1t«a: 

• Checklist  Han  from  operational 
letting 

• Guides  aM  pre-ots 
A»i  data  lied  description 


• Present  knowledge 
of  results. 

• .dent if/  error*. 

• Direct  student  on 
how  to  correct 
error i. 


lias 

performance 

correct? 


Student  verbal  Hcs  or  ph/ilcalt/  per forts  wo tor  response. 

The  students  procedural  responses  mist  be  highly 

V realistic,  although  the  equipment  realism  may  t: 
at  a mint**.  of) 


Present  immediate  know- 
ledge of  results  and 
I reinforcement. 


^ Oo  N 
checklist 
items  renain? 


SUB-CATEGORY  S:  POSITIONING  MOVEMENT  AIlU  RECALLING  PROCEDURES  (Don't) 
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SUB-CATEGORY  3;  POSIiIOIIWC  fSVEttEtIT  A!ID  RECAllMf  PROCEDURES  (Con’t) 


arttiat  tUUI  laforoatloa  ft 
iWttt  e#a  rwoiro 
Ikjtctfrtt  ult#  tfl  KMMM 
hlriirti  for  «cc«a»l  ItWfli . 


fMKU^n  corrocl 
trllll  t>UMt4: 
#l>Un  tad  prrtu  i 

U»IWti  «f 


/ .KfUII  \ 

'n«iuur,  itrtitx 

•U  HIM  H IMHI  . 


/ itutoat  > 
Ht  tr!  tortoa 
for  OfOrillOM) 
\ uuitfi  > 


ruuu  winirl 
M Mitral  I 
rr'tftrfU  it  I 


Ml  crttortoa 
for 

vovorloornt  nfl? 


budoat  ttitt  corroctly 
ptrVt  ttt  rmritrti  T 
ttan  ctfHKHtlvtly  union 
tIM  frllonlaf  Condition!: 

• Oollyad  Ml  vorflobto  kaonloOgt  of  roultl 

• Mtoyof  bad  ttrlnblo  rotufortoaoot 

• ooorottoaol  total  ‘noli#* 

• M-t*o->t  tjrfM  ittMilirt  la  tana  of 

- fO«M 

- coaolaaltr 

- I troll 

• no  OtIOal  #M  tnafti  otbor  tkaa  Mot# 
la  t*o  onorot  ioail  lotting 

• I tool  latooratot  Into  a twth  uouaaco 


Stito  rocMomilitlom  ftr  rtfmktr  training: 

• Strotov  for  rofrouor  training 

* Crttorloa  toil 


GrD 


SUB-CATEGORY  9:  P0SIT1Q.IMG  U0VEME;iT  «4D  RECALLING  PROCEDURES  (Con't) 


"IPPI 
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Menu  of  learning  approaches  to 
strengthen  the  cognitive  component 
of  an  attitude: 

1 . Description  of  Desired  Attitude. 


Repeatedly  present  toe  stuotni 
(2*)  with  t description  of  the 

desired  attitude  or  behavior. 

2.  Peer  Group  or  Authority  figure. 
Communicate  the  feet  tnat  the 
. attitude  of  his  peer  group  or 
authority  figure  dlwers  from 
his  attitude,  and  how  It  differs. 

3-  Cognitive  Dissonance. 

Pi-oduce  cognitive  3TVson*nce 
,,  within  the  student  by  producing 
<•*  « discrepancy  between  two  or  more 

of  his  cognitive  elements. 

4 . Counter  Arqunents  from  Reference 

(2d)  Ensure  that  other  metiers  of  the 
students  reference  group  present 
Specific  arguments  for  the  cognitive 
components  of  the  desired  attitude 
and  counter  arguments  tailored  to 
meet  the  student's  objections. 

5.  Persuasive  Messages. 

Present  previously prepared 

(2a)  persuasive  messages  to  the  student 
with  arguments  why  he  should  adopt 
the  cognitive  components  of  the 
desired  attitude. 

6.  Intensively  Indoctrinate  Student. 
Subject  the  student  to  a- combination 

i of  approaches  Including: 

I (a)  frequent  repetitions  of 

\ descriptions  of  the  attitude, 

1 (?f)  (b)  communications  on  peer  group 
I norm , 

\ (c)  tailored  arguments  to  counter 

1 students  resistance, 

1 (d)  prepared  arguments  attributed 

\ to  a high  prestige  source 

1 Mote:  #See  guidelines  for  Implementation 
1 data 

l •> earning  approaches  are  listed 

1 in  order  of  power,  the  last 

l being  most  powerful. 


Choose  and  Implement  a learning 
approach  to  strengthen  the 
cognitive  component  (perception 
knowledge,  information)  of  the 
desired  attitude. 


/ Has  \ 

/r  cognitive  \ 
component 
been  adequately 
v strengthened  y 


Choose  and  implement  a learning 
approach  to  strengthen  the 
behavior*!  component  (responses, 
acts,  deeds)  «f  the  desired 
attitude.  _____ 


/ Has  \ 
r behavioral  X.  No 
component  \ 
been  adequately  yf^ 
v strengthened y^ 


Give  criterion  test  for  desired 
attitude  and  behavior. 


I He.iu  of  learning  apir  <‘‘hes  to 
/ strengthen  the  behavr. 

I component  of  an  attitjce. 

I • Act  Opt  Behavior:  Require  the 

f subject  to  11  act  out"  the 
behavioral  aspects  of  the 
1 3*1  attitude  by  role  pUylny  or 
perforr  the  desired  behavior 
In  the  operational  setting. 
m Public  Commitment:  Encourage 

student  to  publicly  announce 
(3f,>  his  conformity  and  allegiance 
to  t Y*  desired  attitude. 
m Conditioning:  Place  student  In 

rjoK-TlTesettlng  and 
reinforce  any  behavior  that 
(3c)  seems  -.0  be  a product  of  or 

compatible  with  the  desired 

i attitude. 

\ Note:  • See  guidelines  for 

\ Implementation  data. 

\ # Learning  approaches 

\ are  listed  In  order 

\ of  power,  the  last 

\ being  most  powerful . 


student  performs  test 


/ Does  \ 
^ student  X 
have  desired 
attitudes  and 
behavior  > 


SUB-CATEGORY  11:  ATTITUDE  LEARNING  (Con't) 


Best  Available  Copy 


FIGURE  m.1:  Flowchart  of  Block  HI  .1:  SPECIFY  LEARNING  EVENTS/ACTIVITtES 


BLOCK  II I. 2: 


SPECIFY  INSTRUCTIONAL  MANAGEMENT  PLAN  AND  DELI&RY  SYSTEM* 
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OVERVIEW 


Media  selection  Is  the  major  means  of  determining  how  instruction  Is 
to  be  packaged  and  presented  to  the  student.  The  choice  of  acedia  mix 
affects  both  the  effectiveness  and  cost  of  training.  The  Instructional 
management  plan  is  the  set  of  procedures  used  to  assure  a smooth  flow 
of  students  through  the  training  system.  The  System  Master  Plan  Is  the 
controlling  document  for  the  further  development  and  Implementation  of 
the  instructional  system. 


♦Portions  of  this  material  have  been  adapted  from:  Braby,  R.,  Henry,  J.  M., 
Parrish,  F.  W.,  Or.,  and  Swope,  W.  H.  A technique  for  choosing  cost- 
effective  delivery  systems  (TAEG  Reportllo."  16).  Orlando,  FIT:  Training 
Analysis  and  Evaluation  Group,  NTEC,  April  1975. 
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SPECIFY  INSTRUCTIONAL  MAMAGMT  PLAN  AID  DELIVERY  SYSTEM 

1.0  INTRODUCTION 

1.1  Media  Selection 

Med<a  selection  Is  the  major  means  for  determining  how  the  Instruction 
Is  to  be  packaged  and  presented  to  the  student.  The  choice  of  the  media 
mix  affects  both  the  effectiveness  and  the  cost  of  training.  Choosing 
the  best  or  most  usable  mix  of  Instructional  media  Is  difficult  to  do. 

A systematic  approach  requires  a consideration  cf  the  nature  of  the 
objectives,  the  learning  category  of  each  group  of  objectives,  use  of 
learning  guidelines,  development  of  activities  based  on  these  guidelines, 
definition  of  the  stimulus  requirements  for  those  activities,  selection 
of  media  mixes  that  have  the  characteristics  needed,  consideration  of 
constraints,  costs  of  procurement  and  operation  of  alternative  media, 
courseware  development  costs,  and  characteristics  of  the  student  popu- 
lation. 

Media  can  be  classified  and  described  in  multiple  ways.  Appendix  A 
lists  media  and  media  mixes  under  the  headings  “Audio  only,  Audio-Visual, 
Computer-Simulation,  Visual  only.  Print  Materials,  and  Special  and  Non- 
standard Items." 

1.2  Management  Guidelines 

An  Instructional  system  must  be  managed  to  ensure  the  smooth  flow  of 
students  through  the  training  systam.  It  requires  provisions  for  students, 
instructors,  support  personnel,  facilities  and  equipment,  courseware,  and 
organization.  All  of  these  interact  and  a decision  on  scheduling  any  one 
may  effect  how  the  others  must  be  managed.  This  is  true  even  with  an 
outwardly  simple  procedure,  such  as  the  situation  when  an  instructor  is 
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lecttring,  testing,  grading,  and  moving  on  to  the  next  lecture  In  a 


group.  Wien  each  student  Is  moving  through  different  kinds  of  Instruc- 
tional materials  at  his  own  pace,  even  more  planning  Is  required. 

1.3  System  Waster  Plan 

A System  Mister  Plan  (SMP)  Is  required  to  coordinate  the  efforts  of 
those  who  will  develop  and  implement  the  Instructional  program.  While 
this  document  Is  subject  to  revision  as  Instructional  development  con- 
tinues, many  reasonably  firm  decisions  can  be  made  at  this  point  in 
the  model. 

The  procedures  for  activities  in  this  block  are  shown  in  Figure  III. 3, 
the  fold-out  page  at  the  end  of  the  block. 

2.0  PROCEDURES 

2.1  Select  Pool  of  Media  Mixes 

The  first  step  in  this  block  Is  to 
identify  a list  of  media  mixes  or  altern- 
atives. A media  alternative  Is  a form  of 
instructional  material  that  contains  the 
stimulus  criteria  required  by  a specific 
learning  activity.  Identification  of 
media  alternatives  is  done  by  selecting 

those  media  within  the  learning  category  that  have  the  required  stimulus 
criteria.  These  become  candidates  for  possible  use  as  part  of  the  final 
delivery  system. 

Required  stimulus  criteria  are  those  basic  qualities  or  capabilities 
of  a medium  (such  as  visual  Images,  motion,  color,  and  sound)  that  are 


J 
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required  to  carry  out  the  Intent  of  a learning  activity.  These  required 
stimulus  criteria  can  be  specified  by  types  of  stimulus  Inherent  In  the 
learning  activity*  the  student  response,  and  performance  feedback  demands 
of  the  learning  activity. 

In  Block  III .1  the  learning  objectives  were  classified  according  to 
learning  sub-category.  The  learning  guidelines  were  Identified  for  each 
sMb-category.  The  list  of  learning  guidelines  for  each  set  of  similar 
objectives  were  then  used  to  plan  learning  activities.  Figure  III. 4 
shows  the  reverse  side  of  a Learning  Objective  Analysis  Worksheet.  In 
this  block,  you  will  primarily  be  using  this  reverse  side  of  the  form. 

Use  this  form  as  a worksheet  to  make  media  selections. 

Following  Is  a continuation  of  an  example  used  in  the  last  block. 

The  terminal  learning  objective  is:  identify  US  and  USSR  destroyers. 

Some  of  the  learning  objectives  are: 

Learning 

Sub-Category Learning  Objective  Action  Statement 

CLASSIFYING  1.  Classify  Claude  Jones  Class  as  US  or  USSR. 

CLASSIFYING  2.  Classify  Forrest  Sherman  Class  as  US  or  USSR. 

CLASSIFYING  3.  Classify  KOTLIN  Class  as  US  or  USSR. 

CLASSIFYING  4.  Classify  RIGA  as  US  or  USSR. 

CLASSIFYING  5.  Classify  KOLA  Class  as  US  or  USSR. 

The  learning  activities  for  all  five  objectives  are  so  similar  that 
you  may  make  decisions  lor  the  whole  group  at  the  same  time. 


.1  __.il 


Learning  Category 


STIMULUS  CRITERIA 
Vi**  fr*m 


Piet  or*,  W*m 

UM  C<W4M*Ctk*»(  PtWM- 

Obf«ct,  $el*e~-a 

FuM  vie**  •**iro***>t — 
Vi**  Mowmma( 

Si  III 

MtW 

Full 

Vlaual  SfMctnjtn 


Vain  ‘nwd  Rjn«a — 

Fui  ; uooad  Him  — 

mim  too  an * — : 

LtiNar 

TactUa  Cuw 

laaamti  Stlnatiua  Mm  Ion  Qiaa 

Emarnal  Stimiku  Motion  Cuoa.  — 
Floo  maw  anti  maalpulatNo  Ada — 
■load  Maiimani  manlpulotiw  Acta. 

TRAINING  WITTING  CRITERIA 

lndMtiuN  Tialnoa  Of  loan  nation  01  a 
Fi»ad  Location  - -■  ■ ■ 

lajtiaduat  Tralaaaa  with  timititananua 

timruction  or  many  location 

ladhndual  Trolaoa  or  taoai  tia.nlna  with 
IndauaaOaai  laatruetien  at  arty 

Location  — 

Intirritiuoi  Tialnoa  on-tha-iot), 

Small  Giow 

Lar«a  Grow  at  $ln|la  Location 

Toon  Sonina 

ADMINISTRATIVE  CRITERIA 
Sitaof  Couraaawra  Dawtioixwant 


Learning  Objective  Analysis  Worksheet 
(Reverse  Side) 
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tiwber 


learning  Guidelines 


Clearly  infort  the  trainee 

Display  distinctive  features 
of  the  pattern 

ProV  1e  opportunities  for 
practice 


Provide  full  range  of 
patterns 


State  the  objective  In  writing. 

Call  attention  to  the  differences 
in  each  ship  In  pictures. 

Practice  Identifying  by  looking 
at  pictures  with  correct  Identi- 
fication available  Immediately. 

Shew  varying  views  of  the  ships. 


The  number  for  each  learning  guideline  chosen  for  use  for  these 
learning  objectives  Is  listed  In  the  extreme  left-hand  column.  For 
this  example,  only  a subset  of  the  possible  leaning  guidelines  are 
used.  The  guideline  statements  for  each  learning  guideline  number  are 
round  under  CATEGORY  VII:  Classifying  - Recognizing  Patterns,  in 
Appendix  A of  Block  III .1. 

From  those  learning  guideline  statements,  the  learning  activities 
shewn  in  the  example  above  were  derived.  This  was  done  in  Block  III .1 . 
These  activities  should  have  been  entered  In  the  Learning  Activity  column 
on  the  left-hand  side  of  the  worksheet  (Figure  I II. 5). 

Each  of  these  learning  activities  now  must  be  translated  Into  applic- 
able stimulus  criteria.  The  possible  stimulus  criteria  are  listed  in 
the  center  column  of  the  worksheet.  If  the  activity  Involves  sound  alone, 

consider  the  choices  under  audio  «stimuli.  If  the  activity  Involves  visual 

* 

stimuli,  specify  which  visuals  are  needed.  For  each  stimulus  criteria 
applicable  to  the  selected  learning  activities,  put  a check  mark  after 
the  appropriate  stimulus  criteria  on  the  worksheet.  These  are  very 
Important  because  they  will  be  the  basis  for  selecting  the  pool  of  media 
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EXAMPLE 

Activity  1 requires  a visual  form- -alphanumeric  (combination  of 
letters  and  numbers) 

Activity  2 requires  a visual  form— alphanumeric  and  pictorial,  plane.  j 

Activity  3 requires  the  same  visual  form  plus  additional  alpha- 
numeric means  of  giving  feedback. 

Activity  4 requires  the  same  visual  forms. 

Now,  uslnq  the  worksheet,  go  down  the  list  under  Visual  Form  and  check: 

l 

"Alphanumeric"  j 

"Pictorial,  plane." 

i 

i 

Under  Visual  Movement,  nothing  indicated  a need  for  movement,  so  check:  I 

"Still."  j 

Under  Visual  Spectrum,  nothing  Indicated  a need  for  color  so  check: 

"Slack  and  White." 

Under  Scale,  nothing  indicated  exact  scale. 

Under  Audio,  no  activity  indicated  a need  for  audio. 

I 

j 

The  worksheet  should  now  look  like  Figure  I I I. 6. 

The  next  step  Is  to  take  the  learning  sub-category  (the  learning 
objectives  were  classified  according  to  learning  sub-category  In  Block 
1II.1)  for  the  learning  objective  or  group  of  learning  objectives,  and 
locate,  In  Appendix  B,  the  appropriate  matrix  for  that  learning  sub- 
category.  A sample  of  one  of  the  matrices  is  shown  in  Figure  III. 7. 

The  items  on  the  matrix  are: 

A.  Criteria  for  Media  Selection 

B.  Complexity  Criterion 

C.  Stimulus  Criteria 

D.  Training  Setting  Criteria 


Luvning  Catagory 
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Madia  SWactioftCritwU 

!/l 

Madia  Pod 

1 _ -- 

turnip  Activity 


1.  State  the  objective  In 
writing. 


Call  attention  to  the 
differences  In  each  ship 
In  the  pictures. 


Practice  Identifying  by 
looking  at  pictures  with 
correct  Identifications 
available  Immediately. 


Show  varying  views  of 
the  ships. 


COMTlSXirV  CfltTERIA 

OHicuta  Motor  Acta — 

Smooth  Farformaac*  at  a**4  o< 


STIMULUS  CRITERIA 
'feud  Earn 


Uat  Construction,  Plana 

Qb|act,  Solid — 

f u*  virtual  «wkwwM  «. 
Viauai  Mourn Mat 

Still 


V_: 

"*S 


?u» 

Visual  Spactrum 
Biw*  and  Whita- 
Qray  Stm 

C OiOf 


Exact  Scat*- 

A.Tto 

Vo..*v  Sound  Ranga- 
Full  Sound  Rang#— 
Antalam  Goundi^ — 


Madia  Salaction  and  Rational* 


intamd  StimuKii  Motion  Cuaa_ 
Cxtamal  Stimukit  Motion  Coat- 
Fina  inovemant  mamp'rtativ*  Ad 
Bioad  Mountain  marupvlatlvu  A 


TRAIN  (NO  SETTING  CRITERIA 

Individual  Train**  or  taam  training  .*  a 

Fixad  Locution 

Individual  Yrattuaa  wkh  atmuttanaoua 

instruction  or  many  location#  — ■ 

individual  Train##  c/  want  train**  vjitli 
Indapan^artt.lnatrucflon  at  any 

Location  ■ ■■  - — - 

Individual  Trait**#  pn-tha-joh 

Small  Group  ■ — — — 

Larga  Group  at  Singl*  Lo-atbn 

Taam  Sotting ■ — — 


administrative  criteria 

Sit#  Of  Coort*v*art  Davdopma.it 


Cantral 

Mtpnituda  of  Acquisition  Coat 
Uva^—  . 

High 


FIGURE  IIJ.6:  Sample  Worksheet 


SUB-CATEGORY  2 
CLASSIFYING 


OtmiiOBtl 

to  eitMU  * ual ivory 
lyatut 

l.  »u«  * * J • itifkt 

P*WAII  il  tout 

«rU»ri« 

<»•«*)  that  MBit  Oo  Mt. 

i.  Iil«ct  tho  delivery 
tyatonn  (col  unn  a t that 
fc4V«  an  iii  each  rw 

4«iifMt«4  by  a V . 
'»>»•■*  an  the  cia4i(l«t* 
^delivery  ay • tana. 


Altariutiva  Uitraetionil  fitlnary  lyitaai 


■ool  Ivory  Approach*!  j||  Delivery  Approach**  * 

feemUtinq  the  AppUc«tton||f  Serai  t«U<*  CeapUU 
•t  All  Uimat  Gtiidt  lAtil  Application  ol  uirm 


Delivery  Approach* a ROY 


••4  Aiqor.tha 


AppUcatton  el  Uirninq 
C*>  L de  1 i on*  and  AifvrlUia 


crittiU  for 
Jalaot 4 Of 
Instructional 
Oalivoty 

lyitaai 


ItiauiiM  Critari* 

• Vleoal  S’ OCR 

AlpMauaaiic  * 
PUUiLal,  Plina 
Llaa  Coaakiuekion,  Vlas* 
Ob)act,  Solid 
Xnvironaent 

• Visual  Moveaen  t 

Still 

lUUtA 

full 


_X  X X X 

X _JL 

X 


inact  scale 


Vale#  Aourd  Mi»«« 
roll  Sound  fcanqc 
Aablant  Sound* 

Other  ictiia  cuoa 

Inker  si  StlRdlua  m 


l^aiail  Stimulus  Motion  Cuoa 

| Training  Sotting  Criteria 

» Individual  Trainee  at  a rived  Location 
t Individual  Yrainoo  vlth  independent 
tnatr >ction  at  Any  Location 
4 Snail  Group 

» Larpa  Oroup  at  Slnqla  Locat ion 

/.  ala  (strati  va  Criteria 

• Site  of  cruraavara  and  spociel  sard* 
ware  Oevoioonont 


• Magnitude  of  Acquisition  Coat 


X X X 
X I X X 


XXX x_ 

X 


_X X XXX 

X X XXX 

T — 777 


FIGURE  III. 7:  Sample  Matrix 
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£.  Administrative  Criteria 

F.  Alternative  Instructional  Delivery  Systems: 

G.  Media  Approaches  which  permit  the  use  of  all  learning 
guidelines  (events)  for  that  learning  category,  and 

H.  Media  Approaches  that  permit  use  of  only  some  of  the 

learning  guidelines. 

I.  The  iiamas  of  the  media. 


It  should  be  noted  that  a1J_  cf  the  above  criteria  for  media  selection, 
which  Includes  sections  B,  C,  0,  and  E of  the  Matrices  will  not  be  present 
for  each  sub-category.  When  one  or  more  criteria  are  missing  it  is 
assumed  that  the  media  cnoices  available  for  that  particular  sub-category 
cannot  be  differentiated  on  the  basis  of  the  missing  criteria  or  are  not 
neec'ed.  That  is,  each  medium  Is  presumed  to  be  equally  effective  for 
delivering  the  Instructional  material  in  reference  to  the  missing  cate- 
gories. Therefore,  the  media  selection  will  be  based  on  the  criteria 
that  are  present  and  on  cost  factors. 

In  the  example,  note  the  Stimulus  Criteria  items  checked  in  Figure  m.7. 
For  each  stimulus  criteria  checked,  folic  : across  and  note  where  x's 
appear  for  that  stimulus  criteria  under  different  media  approacnes  that 
have  x's  for  all  the  checked  stimulus  criteria  items. 

Thus  far  in  the  example,  the  following  media  choices  should  have 


been  noted. 


( i 


Next,  look  at  other  criteria.  Going  on  down  the  matrix  to  the 
Training  Setting  Criteria,  are  there  any  special  constraints  that  need 
to  be  considered?  In  the  example,  the  terminal  objective  is  for  train 
lug  in  school  or  In  a unit.  That  would  include  individual  trainees 
with  independent  instruction  at  any  location.  Now  select  the  media 
with  matching  x’s.  These  three  remain. 
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Now,  go  on  down  the  matrix  to  Au  'i strati ve  Criteria.  In  the 
example,  the  course  Is  to  be  developed  centrally  and  you  have  been 
directed  to  keep  the  acquisition  costs  iow. 

This  additional  information  does  not  change  the  set  of  three  choices. 
Record  the  three  choices  on  the  worksheet,  fha  worksheet  will  .iow  look 
like  Figure  III. 8. 

f 1 


2.2  Hake  Media  Selection 
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Media  Pool 


Modi*  Selection  Criteria 


Learning  Activity 

1.  State  the  objective  In 
writing. 

2.  Call  attention  to  the 
differences  In  each  ship 
In  the  pictures. 

3.  Practice  Identifying  by 
looking  at  pictures  with 
correct  Identifications 
available  lunedlately. 

4.  Show  vary.ng  views  of 
the  ships. 


COMPLEXITY  criteria 

CMIka.Ii  Km>  AcK  _ - 

Smoodt  Motor  McnwKt  «t  and  ol 
Training 


STIMULUS  CRITERIA 
Vituei  Form 

Alphonumette  — ..  , 

Pictorial,  Plane 

Line  Conacruetion.  Plane - 

Obltct.  Solid — 

Pud  viiuai  environment— 
Vlauai  Movement 

Still 

Limited — 

Pud — 

Vitool  Spectrum 

Bier*  end  'VMM — 

Grvy  Scale- — — — 

Colne  


| Study  card  sets 

Microfiche 

I l/  Sound  sllde/fllm  strips 


..iZj 


Exact  Scalp  . . 

Vain*  Sound  Range 

Pull  Sound  R-ngc 

Arabian!  Sounda 

Other 

Ttctilo  Cuot  — - — ...  — — 

Internal  Stirnulut  Motion  Cum 

External  Stlmuku  Motion  Cuot 

Pino  movement  manipulative  Acta 

Broad  Mom  moot  manipulative  Ami — 

TRAINING  SETTING  CRITERIA 

Individual  Trolnao  or  loom  training  it  a 

Plxad  Location  ---  ,, . 

indMduai  Trainee#  with  alnv'taneout 
InecrucGor  or  many  loaaiiona  — . — 
I nd  rvalue!  Tralnaa  or  team  training  with 
independent  Instruction  at  my 

Location  - - — ■ ■ ■ 

individual  Trainee  on-the-|ob 

Small  Group 

Large  Group  at  Slnjlf  Location 

Toom  Sotting 

ADMINISTRATIVE  CRITERIA 
Slit  of  Counmvara  Development 

Local 

Central. 

Magnitude  of  Acouit'llon  Con 

Low 

High 


Madia  Selection  and  Rationale: 


i-'IGUKE  III. 8;  Sample  Worksheet 
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that  are  Impractical.  The  media  types  that  remain  are  considered  to 
be  candidates  for  tee  In  the  proposed  system,  and  will  be  subjected 
to  a cost  analysis.  Some  of  the  factors  that  may  be  Important  In 
rejecting  media  types  are: 

1.  Marginal  Technical  Solutions:  The  learning  guidelines 
cannot  be  easily  carried  out  with  the  medium. 

2.  State-of-the-Art:  The  basic  medium  Is  under  development 
or  test  and  may  not  be  available  for  practical  application 
by  the  time  It  Is  required. 

3.  Size  of  System:  Some  media  are  useful  within  large  training 
programs,  others  are  suited  only  for  small  programs,  and 
therefore  may  not  be  suited  to  the  size  program  being 
considered. 

4.  Interface  with  Existing  Program:  Many  new  courses  must  be 
designed  to  fit  into  existing  programs,  which  places  con- 
straints on  the  new  courses;  e.g.,  equipment  cn  hand, 
available  classrooms,  scheduling  practices,  etc. 

5.  Time  to  Produce  Media:  Media  which  require  long  lead  times 
for  development  may  not  be  useful  when  scheduled  ready-for- 
tralnlng  dates  do  not  allw  a long  development  cycle. 

6.  Budget  Cycle  Constraints:  While  the  application  of  soma  of 
the  powerful  training  approaches,  such  as  CCTV  (closed  circuit 
television),  my  result  in  low  cents  per  student  graduate,  the 
Initial  Investment  is  substantial.  Unless  these  resources 
appear  in  existing  budgets,  the  application  of  these  tech- 
niques to  an  immediate  problem  is  not  feasible. 
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'/.  Adoption  of  Innovations:  Project  team  members  frequently 
resist  Innovations.  If  the  proposed  media  Is  significantly 
different  from  existing  techniques,  either  adequate  resources 
must  he  focused  upon  gaining  acceptance  for  tfie  innovation, 
or  a more  traditional  approach  must  be  selected. 

8.  Courseware  Development:  If  the  courseware  is  to  be  locally 

« 

developed,  skilled  personnel,  equipment,  time,  and  dollars 
must  be  available. 

9.  High  Cost  Alternatives:  The  projected  life  cycle  cost  of  a 
media  approach  may  be  significantly  higher  than  other  equally 
useful  alternatives.  Reject  high  cost  alternatives. 

10.  Learning  Style  of  Trainees:  If  trainee  has  low  reading  ability 
or  would  be  limited  in  his  ability  to  use  certain  kinds  of 
media,  then  reject  these  media  as  inappropriate. 

11.  Other  Constraints:  A variety  of  other  practical  factors 
should  be  considered;  e.g.,  command  policy  and  existing 
Investment  In  production  facilities. 

Table  III. 8 gives  examples  of  possible  rejection  rationale  for  different 
media. 

Based  on  the  rejection  rationale  just  discussed,  make  a tentative  final 
media  selection.  In  the  example,  apply  some  experience  and  judgement. 

Sound  slide  programs  can  be  used  by  individuals  and  by  groups,  but  they 
also  have  an  audio  track  that  is  not  required.  The  microfiche  requires 
a reader  which  the  study  card  sets  do  not.  Make  a tentative  choice  for 
the  stuefr  card  sets  and  the  microfiche.  The  worksheet  will  now  look 

f 

| like  Figure  III.9. 

1 

I 

i 


i 


) 


i 
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TABLE  III. 8:  EXAMPLE  OF  REJECTION  RATIONALE 


Initial  List  of  Media 

Rejected  Impractical  Approaches 

1. 

Laboratory  Carrel 

2. 

Teaching  Machine,  Branching 
with  Adjunct  Equipment 

3. 

Programned  Text,  Branching 

Rejected:  Too  extensive  use  of 

with  Adjunct  Material  and 
Equipment 

written  material . 

4. 

Procedure  Trainer  with 
Adjunct  Display  and  Logic 

5. 

Procedure  Trainer  with 
Instructor 

6. 

Logic  Trainer 

Rejected:  Marginal  Technical 
Solution. 

7. 

Operational  Equipment  with 
(Programmed)  Manuals 

8. 

Operational  Equipment  with 
Instructors 

9. 

Microform  with  Information 

Rejected:  Too  extensive  u$e 

Mapping  and  Adjunct  Equipment 

of  written  material . 

10. 

Simulator  with  Adjunct 
Displays 

Rejected:  Budget  Cycle  Constraints, 

11.  Television,  Video  Disc 
and  Adjunct  Equipment 


Rejected:  Inadequate  State-of- 
the  Art. 

j 


NOTE:  Example  assumes  that  • 

trainees  have  low 
reading  ability. 


l 

1 
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M#rtu  Pool 


Laarnlng  Citaaory 


Madia  Salaet'on  O.taria 


Laa-rtlng  Activity 

1.  State  the  objective  In 
writing. 

2.  Ca’l  attention  to  the 
differences  in  each  ship 
In  the  pictures. 

3.  Practice  identifying  by 
looking  at  pictures  with 
correct  identifications 
available  immediately. 

4.  Show  varying  views  of 
the  ships. 


cowetr  iTvcnnrtm* 

Om-oiU  M«««f 

tanaa  Mm>  Mwaun  t 


stimulus  cm itshia 


Study  card  sets 
Microfiche 

Sound  slide/ film  strips 


TwiiCta  . ■ - . 

(MtriMl  MotteA  Cuts 

Euarntf  sum**  afcntoa  Coat 
VWa  inww  —WaalatW 


Madia  SnUeUon  and  Rational*: 


Study  Card  Sets: 

Since  the  study  card 
sets  are  less  expensive 
and  do  not  require  a 
reader,  and  at  the  sane 
tine  can  present  the 
Instructional  material 
as  effectively  as 
microfiche  or  a film 
strip,  the  card  sets 
were  selected  as  our 
media  choice. 

Sound  was  not  required, 
therefore  the  use  of 
sound  slide/film  strip 
was  not  chosen.  In 
addition  to  this,  a 
longer  production  time 
would  be  required  for 
sound  sltde/fllm  strip. 


FIGURE  111,9:  Sample  Worksheet 
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2.2.2  Recownend  the  Optimum  Media  Mix 

The  selection  of  one  of  *he  media  mixes  and  the  justification  of  this 
choice  Is  based  on  weighing  the  variations  In  cost  among  the  useful  can- 
didate media,  along  with  the  relevant  administrative  factors,  that 
Influence  media  selection  Irrespective  of  technical  solutions. 

2.3  Determine  Management  Guidelines 

bi: 

2.3.1  Mode  of  Instruction 
Instructional  management  plans  can  bo 

usefully  divided  Into  two  general  categories: 
those  employing  block  scheduling,  and  those 
using  self-pacing  modes.  Group  Instruction 
has  been  widely  used  In  educational  settings, 
most  notably  In  public  schools,  and  consists  of 
an  instructor  managing  a number  of  learners  In  a fixed  sequence  of  events 
and  activities.  All  of  the  learners  go  through  the  same  sequence  at  the 
same  time. 

Self-pacing,  the  second  general  kind  of  Instructional  management,  is 
usually  the  preferred  mode  In  ISD  courses.  Which  of  the  forms,  or  varia- 
tions, to  use  should  be  based  on  the  setting,  the  needs  of  the  learners, 
and  che  resource  constraints. 

Details  of  various  management  plans  are  given  In  Appendix  C of  this 
block. 

2.3.2  Selecting  Block  Scheduling  Plans 

Select  block  scheduling  when  any  of  the  four  following  conditions 


exist: 
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*-  , A . _ . 


1.  When  socializing,  or  exchange  of  views,  or  other  such 
group  Interactions  are  the  desired  Instructional  outcome 
of  the  course; 

2.  When  the  performance  conditions  of  the  objectives  of  a 
course  Indicate  group  or  team  performance  Is  required; 

3.  When  course  content  Is  so  unstable  as  to  make  It  change 
often; 

4.  When  a course  Is  known  to  have  a short  life. 


A common  method  of  group  assignment  Is  random;  that  Is,  students 
are  assigned  to  groups  alphabetically,  by  service  number,  etc.,  or  In 
the  order  In  which  they  happen  to  walk  through  the  door.  This  results 
In  a wide  -ange  of  student  characteristics. 

Even  when  a group  management  plan  Is  used,  some  Improvement  can  be 
achieved  through  the  method  In  which  students  are  assigned  to  the  groups. 
Two  alternate  methods  of  group  assignment  are: 

1.  Ability  grouping  - Students  are  assigned  to  groups  on  the 
basis  of  aptitude  testing. 

2.  4ch1evement  grouping  - Students  are  assigned  to  groups 
according  to  their  performance  on  pretests  of  units  of  the 
course.  This  sometimes  allows  students  to  skip  some  units 
and  move  on  to  the  following  units,  perhaps  to  join  more 
advanced  classes. 

2.3.3  Selecting  Self-Paced  Management  plans 


Because  students  are  so  different  in  their  rates  of  learning  and 
other  characteristics  that  affect  behavior  In  course  work,  self-pacing 


r;  ■ 
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Is  usually  preferred  over  regular  block  scheduling.  This  does  not 


| 


J 


mean  that  In  a self-paced  pi  an , a group  cannot  meet.  For  some  lessons, 
all  members  of  the  class  might  participate  as  a group,  but  not  be  kept 
In  lock-step.  Or.  as  a certain  number  of  students  reach  the  point  of 
needing  a specific  type  of  Instruction,  they  can  meet  as  a small  group 
and  then  again  proceed  at  their  own  paces.  In  general,  though,  Indi- 
viduals come  to  the  Instructional  settings  with  such  a variety  of 
achievements  that  adapting  the  Instruction  to  these  differences  Is 
desirable  In  order  for  the  maximum  number  to  reach  mastery-  In  a 
block  scheduled  system,  Individuals  are  often  moved  on  or  out  regard- 
less of  whether  or  not  they  master  the  objectives  of  Instruction.  In 
the  self-paced  setting,  adjustments  in  the  system  are  made  so  that  It 
adapts  to  many  factors: 

Variations  in  the  experience  each  individual  has  had 

before  coming  to  the  instructional  setting; 

- Personal  learning  and  performance  rates. 

Whatever  these  individual  differences  are,  the  system  must  account  for 
them  in  enough  ways  to  result  in  student  mastery  of  objectives,  rather 
than  resulting  only  In  comparisons  of  student  performance  on  one 
Instructional  path. 


I 
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2.3.4  Course  Management 


r 

\ 

I 


Someone  must  be  in  charge  of  administering  a course  whether  It  is 
offered  in  a group  mode  or  an  individual  mode.  An  Instructor  is  often 
assigned  to  this  position.  However,  In  large  training  facilities  that 
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process  a high  volune  of  students,  administrative  functions  are  sometimes 
assigned  to  one  member  of  an  Instructor  team  or  to  a central  office  staff. 

Administrative  duties  Include  activities  such  as  scheduling,  requi- 
sition, supervision,  monitoring,  documentation,  -id  reporting.  These 
activities  apply  mostly  to  the  course  Itself  ard  might  be  tailed  course 
management  activities. 

The  school  or  Instructional  unit  may  be  organized  In  various  ways. 

The  organization  may  be  fixed.  If  so,  adapt  the  management  plan  to  fit 
It,  if  not  change  It  to  fit  the  needs.  Two  organization  charts  are 
displaced  in  Figure  III. 10. 

Develop  a management  plan  Jwt  will  fit  the  setting,  delivery  system, 
and  any  command  or  resource  constraints.  Provide  manage, -fieri t for  students, 
instructors,  support  personnel,  facilities  and  equipment,  and  information. 

2.3.5  Students 

For  students,  decisions  must  be  made  about  entry  points,  scheduling, 
completions,  ^cycling,  and  exiting.  Students  may  be  allowed  to  enter 
only  at  one  point  or,  as  a result  of  testing,  permitted  to  enter  at  ae 
advanced  point  or  enter  only  after  some  preparatory  instruction.  Most 
of  these  decisions  were  made  in  Block  II. 3,  but  must  be  finalized  here. 


EXAMPLE 


In  a Flight  Screening  Program,  T-41  coruse,  students  with 
prior  flying  experience  may  be  sufficiently  proficient  to 
be  advanced.  The  levels  of  performance  are  established 
in  the  course  syllabus.  Scheduling  can  be  individual,  by 
homogeneous  grouping,  or  by  mixed  grouping.  Individuals 
may  he  paced  or  allowances  made  for  self-pacing. 


Counselor* 


Support 


Students 


Instruct  urs 


Counselors 


•Support 


•Stur<«nts 


■ Instructors 


-Counselors 


'Support 


* Students 


I 


FIGURE  HI  ,1J:  Two  Alternate  Organisation  Charts 
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EXAMPLE 

In  the  T-41  course  which  Is  designed  to  provide  a 
selection  process  to  Identify  trainees  who  possess 
the  potential  to  complete  Undergraduate  Pilot  Train- 
ing, each  student  Is  considered  individually  and  Is 
allowed  to  progress  to  rubsequent  lessons  on  a pro- 
ficiency basis. 


2.3.5  Completlons/Accumulatlons 

If  the  individuals  pace  themselves  in  the  course  they  will  have 


varying  completion  times.  This  requires  either  varied  exit  times  or 
some  provisions  to  accumulate  students  within  the  course-  For  instance, 
accumulated  students  can  beco.ne  tutors  or  be  given  additional  instruction. 


ir 


} 


EXAMPLE 

In  the  T-41  course,  the  airmanship  examination  is  indl 
vidually  corrected  to  100%  during  the  critique.  Stu- 
dents are  authorized  early  release  from  the  critique 
hour  on  a proficiency  basis.  (Students  with  a 100% 
grade  are  not  required  to  attend.) 


2.3.6  Identification  and  Control  of  Marginal  Students 

Students  who  fail  or  have  trouble  with  part  or  all  of  the  course  may 
be  allowed  to  repeat  the  part  they  failed,  and  proceed,  or  recycle  to 
the  beginning.  There  may  be  a need  to  limit  the  number  of  times  a student 
may  review  or  recycle. 


i 
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EXAMPLE 

For  the  T-41  course,  the  rules  for  classification  as  a marginal 
student  p^us  the  repeat  or  recycle  control  procedures  are  des- 
cribed 

Some  guidelines  for  identification  and  control  of  marginal 
students  are  as  follow: 

1.  A student  will  be  considered  marginal  when  he: 

a.  Receives  a grade  of  LI  preceded  by  three  or  more  grades 
of  F or  below. 

b.  Received  a grade  of  U,  and  has  a ‘J  on  one  of  the  pre- 
ceding three  lessons. 

c.  Falls  an  Initial  progress  check. 

d.  Displays  substandard  performance  to  the  extent  that 
close  monitoring  of  his  progress  is  required;  for 
examf le,  four  or  more  consecutive  grades  of  F or 
below. 

2.  When  a student  is  Identified  as  marginal,  the  following 
procedures  will  apply: 

a.  He  will  be  counseled  by  a flight  supervisor  and  a 
record  of  counseling  will  be  cade  on  the  student 
activity  record.  This  counseling  is  accomplished 
to  determine  the  student's  degree  of  understanding 
of  his  weaknesses  and  recommendations  are  made  to 
assist  the  student  in  overcoming  these  weaknesses. 

b.  If  a student  does  not  receive  at  least  a grade  of 
good  on  his  next  flight,  final  check  excluded,  he 
will  be  counseled  by  the  instructor,  or  an  assis- 
tant, and  a determination  will  be  made  as  to 
specific  training  given  on  subsequent  flights. 

c.  Students  will  be  counseled  and  their  training  records 
reviewed  prior  to  the  adnini  strati  on  of  progress 
checks . 

d.  Procedures  above  reflect  the  minimum  required 
counselings;  however,  any  further  lack  of  progress 
will  require  counseling  assistance  by  the  TRCO, 
assistants,  or  flight  supervisors. 

e.  When  identified  as  marginal,  the  student  will  be 
scheduled  to  fly  with  no  more  than  two  instructor 
pilots. 

3.  The  contractor  and  TRCO  will  evaluate  the  records  of 
identified  weak  students  on  a continual  basis  until 
normal  progress  is  established  or  a progress  check  is 
warranted. 
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12.3.7  Program  Completion 

All  of  the  students  exit  the  program  either  as  graduates  or 
"program  incomplete." 

s Mien  a limit  1$  placed  on  the  number  of  times  a student  may  review 

or  recycle,  there  Is  a need  to  provide  an  exit  for  the  "program  incom- 
„ plete"  students.  There  are  also  program  incompletss  oth^r  than  failures, 

who  drop  out  because  of  other  reasons. 

Program  completion  may  be  scheduled  for  the  group,  or,  when  self- 
pacing  has  been  used,  provision  must  be  made  for  a flow  of  graduates. 
There  is  an  interface  with  the  using  command  ‘•nd  personnel  system  at 
this  point. 

Like  each  of  the  other  student  management  considerations,  a decision 
on  this  exiting  has  Implications  on  the  others.  The  plans  for  all  of 
these  become  the  basis  for  the  System  Master  Plan  (Shf)  which  will  be 

discussed  in  the  next  section  and  are  inputs  to  the  instructor’s  guide. 

2.3.8  Instructors 

The  second  main  group  for  which  the  management  plan  is  designed  is 
the  instructors.  For  instructors  make  decisions  about  their  roles  in 
Instruction,  testing,  record  keeping,  and  motivating.  This  instruc- 
tion role  may  include  presenting  information,  giving  demonstrations 
providing  feedback,  tutoring  students,  and  giving  assignments. 

i,  EXAMPLE 

{ In  the  T-41  course:  A study  assignment  for  the  next  day's 

I lesson  will  be  made  at  the  close  of  each  training  period 

f as  directed  in  the  appropriate  Instructor  guide.  Hie  stu- 

| dent  Is  expected  to  come  to  each  class  prepared  to  parti  ci- 

! pate  In  classroom  discussions  on  the  material  being  studied. 

I Evaluation  devices  will  be  used  as  frequently  as  practicable 

| to  promote  student  learning. 


mini 
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Testing  roles  may  Include  only  distributing  written  tests,  monitoring, 
timing,  and  collecting  the  tests,  or  the  Instructor  may  also  be  responsi- 
ble tor  scoring  objective  tests  o?1 2  even  scoring  performance  tests. 


EXAMPLE 


The  types  of  tests  or  checks,  and  the  criteria  for  passing 
the  T-41  course  are  listed  below. 

Phase  Check.  A flight  check  required  by  the  syllabus  of 
Instruction. 

The  f*nal  check  will  normally  be  administered  between  12.5 
and  13.0  hours  for  average  students.  A representative  cross 
section  of  manuevers  are  flown  as  specified.  Check  flights 
will  be  considered  Incomplete  only  when  maneuvers  flown  were 
insufficient  to  enable  the  check  pilot  to  make  a judgment  of 
the  student's  overall  performance.  The  student  will  be  con- 
sidered below  acceptable  standards  if  he  fails  this  check. 

A recheck  will  be  accomplished  without  intervening  instruc- 
tion. If  he  fails  the  recheck  it  will  be  considered  a final 
progress  check  and  will  result  in  recommendation  for  elimi- 
nati on . 

Initial  Progress  Check  (IPC).  A special  flight  check  given 
by  supervisors  to  evaluate  the  progress  and  skill  level  of 
a stuoent  in  a particular  training  phase,  or  a 

Final  Progress  Check  (FPC):  A special  flight  check  given  by 
the  appropriate  supervisor  to  evaluate  the  SKill  level  of  a 
marginal  or  deficient  student  to  determine  whether  the  stu- 
dent has  the  potential  to  successfully  complete 'UPT  or  should 
ue  recommended  for  elimination,  are  given  when: 

1.  A student  receives  three  unsatisfactory  grades,  fails 
to  solo  in  11.2  h'.urs,  or  when  directed  by  the  TRCO. 

2.  If  a student  fails  to  solo  on  the  supervised  solo 
sortie  he  will  be  scheduled  for  an  IPC.  He  must  solo 
on  the  IPC  in  order  to  pass  the  check.  If  he  passes 
the  check,  and  a representative  cross  section  of 
maneuvers  are  flown,  the  flight  will  constitute  a 
completed  phase  check.  If  he  fails  the  check  he  will 
t>e  scheduled  for  an  FPC  on  which  he  must  solo  in  order 
to  pass.  Failure  of  the  FPC  will  result  in  recommen- 
dation for  elimination.  Satisfactory  completion  of 

an  FPC  brought  about  by  failure  to  solo  at  11.2  hours 
will  be  considered  as  completion  cf  the  FPC. 
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3.  Initial  progress  checks  flown  as  a result  of  three 
unsatisfactory  grades  will  be  flown  at  the  level  at 
which  the  second  unsatisfactory  grade  was  awarded. 

4.  If  a student  .'alls  the  C110  sortie  he  will  fly  thQ 
remaining  sortie  with  a military  TRCO.  He  will  be 
stfieduled  for  an  FPC.  Failure  of  the  FPC  will 
result  in  recommendation  for  faculty  board  action. 
Satisfactory  completion  of  the  FPC  will  be  con- 
'Ider*-*  as  completion  of  the  FPC. 

, ' tion  to  bestir  j,  the  Instructor  may  be  respon- 
se for  grading.  The  T-41  grading  instructions  are 
examples  of  the  rating  scale  and  the  evaluation  pro- 
cedures. 

This  section  outlines  the  responsibilities  and  procedures 

for  flight-lire  evaluation  and  grading  for  this  course. 

1.  Levels  of  Performance: 

a.  Unable  to  Accomplish  (U).  The  student  lacked 
sufficient  knowledge,  skill,  or  ability  to  perform 
the  element,  operation,  maneuver,  or  task  correctly, 
without  assistance. 

b.  Fair  (F).  The  student  performed  the  element,  opera- 
tion, maneuver,  or  task,  but  made  some  false  starts, 
repetitions,  or  minor  errors  of  omission  or  commission. 

c.  Good  (G).  The  student  performed  the  element,  opera- 
tion, maneuver,  or  task  correctly,  with  little 
nesitation. 

J.  Excellent  (E).  The  student  performed  tire  element, 
operation,  maneuver,  or  task  correctly,  quickly, 
and  efficiently. 

e.  Demonstrated  (0).  Enter  the  letter  D when  the 
maneuver  Is  demonstrated  only  but  not  practiced. 

f.  Practice.  The  student  conducts  drills  in  the  job 
elem°nt  or  maneuver  to  develop  proficiency. 

g.  Special  Syllabus  Requirements.  Those  Items  .equired 
on  a one-tin*  basis  and  no  provisions  are  made  to 
indicate  Individual  con^let.lon  on  the  record  of 
training. 


2.  Procedures: 

a.  The  rating  scale  above  is  used  to  evaluate  (1)  the 
student's  characteristic  performance  of  each  maneuver 
attempted  during  each  dual  ride,  and  (2)  his  per- 
formance of  maneuvers  on  supervised  solo  missions 
which  can  be  observed  without  compromising  flying 
safety.  This  is  an  absolute  rating  scale,  and  the 
student's  performance  must  be  judged  against  the 
perfectly  performed  maneuver.  Do  not  consider  the 
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type  or  amount  of  training  the  student  has  received. 
Therefore,  when  a student  Is  introduced -to  a maneuver 
he  may  receive  several  r (fair)  or  U (unable  to 
accomplish)  grades.  This  does  not  mean  that  the 
student  Is  unsatisfactory,  but  he  may  be  progressing 
normally,  since  the  average  student  may  be  unable  to 
accomplish  many  maneuvers  the  first  time.  As  soon 
as  possible  after  the  flight,  rate  the  student  on 
the  applicable  ATC  form. 

b.  Immediately  after  evaluation  of  the  Individual  maneuvers, 
the  student's  overall  performance  Is  rated.  The  Instruc- 
tor, using  a relative  type  rating  scale,  determines  If 
on  the  basis  of  training  received  the  overall  grade  Is 
excellent,  good,  fair,  or  unsatisfactory.  The  student 
may  receive  grades  of  F (fair)  or  U (unable  to  accom- 
plish) on  Individual  maneuvers  that  are  relatively 
new  to  him  and  still  receive  as  high  as  an  excellent 
grade  for  his  overall  performance.  An  overall  grade 
of  unsatisfactory  Is  assessed  If  a maneuver  Is  graded 
U when  the  student  has  not  attained  the  required 
satisfactory  level  of  performance.  Fair  (F)  Is  the 
minimum  satisfactory  level  of  performance. 

Record  keeping  roles  range  from  checking  attendance  to 
monitoring  a computerised  information  management  system. 
Recording  procedures  must  be  specified  as  to  timing,  for- 
mat, coding,  reports,  etc. 

The  forms  used  for  the  T-41  course  include  flying  records 
and  activity  records  which  are  put  In  the  grade  folder. 

These  are  described  below. 

3.  tirade  Folder: 

a.  Flying  training  records  will  be  maintained  in  a common 
folder: 

(1)  LEFT  SIDE: 

(a)  ATC  Form  860  Student  Flying  Record 

(b)  ATC  Form  8?8  T-41  Contact  Record  of  Training 
S-V8A-A 

(c)  ATC  Form  879  T-41  Contact  Grade  Sheet 

(2)  RIGHT  SIDE: 

(a)  ATC  Form  803  Student  Activity  Record 

b.  ATC  Form  860,  "Student  Flying  Record."  The  student 
flying  record  is  used  to  record  a chronological  sequence 
of  training  to  afford  Instructors  and  supervisors  a 
ready  reference  for  continuity  of  training. 

c.  ATC  Form  803,  "Student  Activity  Record,"  ATC  forms  will 
be  filed  with  the  most  recent  fonr.  on  top.  Remarks 


m 
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should  be  factual,  objective,  and  concise  and  will  be 
prefaced  with  an  appropriate  short  title. 

A comprehensive  record  of  counseling  will  be  entered 
or.  the  Form  803.  All  comments  will  be  signed  by  the 
person  making  the  entry,  as  well  as  by  the  student . 
Documentation  Is  required  for: 

|1)  Change  of  instructor 

£]  Any  lesson  graded  overall  fair  or  unsatisfactory 
11  Recommendation  for  elimination 

4)  Counseling 

5)  Assignment  to  marginal  student  status 

6)  Grade  folder  review  prior  to  progress  checks 
71  Syllabus  deviations  or  training  waivers 

8)  Incomplete  lesso.is 
(91  Special  requirements  not  completed 
(iO)  Any  unusual  occurrences  that  could  affect 
student  progress  (airsickness,  prolonged 
grounding,  etc.) 


2.3.9  Support  Personnel 

The  next  group  Is  the  support  personnel.  Wien  additional  personnel 
will  be  required,  the  management  plan  must  specify  who,  when,  and  where. 
Support  personnel  include  secretarial  help,  driver-,  content  experts, 
extra  test  monitors,  fixture  or  equipment  operators,  or  movers,  etc. 

2.3.10  Facill ties  and  Equipment 

Facilities  Include  Indoor  or  outdoor  space.  The  management  plan 
must  not  only  specify  what  the  needs  are,  but  also  the  local  reflations 
for  scheduling  the  facilities. 

equipment  includes  the  delivery  system  where  applicable  and  any 
equipment  require;  by  the  instructor  for  demonstration  of  testing  or 
by  the  students  for  practice.  It  may  be  actual  objects,  simulators, 
or  training  aids.  Equipment  must  be  schedule*  from  the  source,  there 
must  be  a plan  for  utilization,  maintenance,  and  any  improvements  or 
modlfi cations  that  are  required  for  training. 
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EXAMPLE 

Part  of  the  fact llty/equlr went  list  from  the  T-41  Is 
shown  below. 

TRAINING  AIDS 


1.  demonstrators  and  Trainers: 

a.  Flight  line 

(1)  Plastic  Model  Aircraft,  T-41 

(2)  Composite  Flight  Attitude 
Indicator  T-41  Dem,  6910L10001330 

(3)  Instrument  Panel,  T-41  Model  A, 
6910L100179J 

b.  Academics 

(1)  Radio  Aids,  T-41,  69L100161J 

(2)  Training  Films- 

(a)  FA703,  (FIC3-0073),  How 
Airplanes  Fly  (Mandatory) 

(b'  SFP113S,  The  USAF  Safety 
Story  (Optional) 


Basis  of  Issue 

l/1ns true tor 
12/course 
4/ course 

1/course 

1/course 


• a 
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2.3.11  Consumables  and  Courseware 

Consumables  or  expendables  include  all  the  paper,  writing  instru- 
ments, and  any  other  things  that  are  used  up  during  Instruction.  Study  I 

'•ard  sets  that  can  be  kept  by  the  learner,  or  workbooks  that  can  only  s 

be  used  once  are  consumable.  All  of  the  consumables  and  any  non-  I 

4 

consumable  adjunct  instructional  materials  like  slides  or  books  also 

3 

must  be  provided. 


EXAMPLE 

The  bibliography  and  basis  of  issue  .ran  the  T-41 
course  Is: 


.r'lnppiipi11 
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BIBLIOGRAPHY 


1.  Training  Manuals.  Pamphlets  and  Technical  Orders:  Basis  of  Issue 


a.  AFP  50-56.  USAF  Physical  fitness  Program  (Male)  1/student 
2.  Study  Guides  and  Workbooks: 


c.  P-V4A-A-AM-SW.  Airmanship 
b.  P-V4A-A-FL-SC.  night  Line.  T-41 


1/student 
1/ student 


3.  Instructor  Guides: 


a.  P-V4A-A-AM-IG,  Airmanship 

b.  P-V4A-A-FS  IG.  Hying  Safety 

c.  P-V4A-A-PT-1G,  Physical  Training 


10/course 

10/course 

10/course 


4.  Text  References  (Optional): 


a.  Seaton.  Physical  Education  Handbook 


1/ course 


2.3.12  Ml seel 1 aneous  Consi derations 


For  all  of  the  tangible  things:  facilities,  equipment,  consumables, 
and  courseware,  the  management  plan  must  describe  how  many  are  needed, 
where  they  can  be  obtained,  what  approvals  are  needed  from  whom,  and 


how  much  time  is  required  to  get  them. 

The  needs  for  facilities,  equipment,  and  consumables  for  the  course 


have  to  be  defined  and  arrangements  made  tc  have  them  available  at  the 


proper  times.  Scheduling  and  utilization  will  have  to  balance  against 
other  competing  demands  for  the  resources.  Regular  maintenance  and  pre- 


vision for  repairs  must  be  made.  Needed  modifications  or  improvements 


to  equipment  or  facilities  will  require  permission  and  resources. 


The  management  system  is  also  a reporting  unit  to  the  organization. 


K' 


It  not  only  is  responsible  for  all  the  above,  but  also  for  keeping  the 
school  command  notified  of  all  required  Information  plus  any  special 
problems  and  unexpected  changes  or  trends. 


One  of  the  more  significant  docunents 
In  the  ISO  process  Is  the  System  Master 
Plan  (SMP) . This  document  will  Indicate 
exactly  how  the  course  Is  to  be  conducted, 
how  the  students  are  to  be  managed,  when 
and  where  they  will  be  tested,  and  all 
other  specifications  for  the  course. 

The  SMP  has  two  principal  functions: 

1.  To  Indicate  to  all  who  use  It  what  Is  to  be  done  to  get 
the  course  all  together.  How  the  pieces  work  together, 
and  what  each  student  Is  to  do. 

2.  The  SMP  will  be  used  by  the  Internal  evaluator  to  plan 
and  conduct  the  Internal  evaluation.  The  more  explicit 
the  plan,  the  more  carefully  and  exactly  the  cou.se  can 

be  evaluated.  The  SMP  will  serve  as  the  basis  for  finding 
discrepancies  in  course  Implementation. 


The  SMP  will  specify  the  media  tc  be  used,  the  kinds  of  Instructional 
materials  to  be  used,  the  tests  that  will  be  given,  and  when  they  will 
be  given,  what  the  instructors  will  be  expected  to  do,  what  the  time 
schedule  and  physical  layout  of  the  facilities  is,  how  students  can  be 
placed  in  more  advanced  units  or  how  they  can  by-pass  or  retake  the 
units,  and  the  other  necessary  technical  details  of  the  course  plan 
required  by  standard  operating  procedure  or  regulation. 

The  Intention  of  the  system  master  plan  is  to  communicate  with 
Instructors,  managers,  students,  and  evaluators  exactly  what  is  supposed 
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to  happen  In  relation  to  everything  else  that  Is  supposed  to  happen. 

The  SMP  also  Is  a major  Input  to  the  Instructor's  Manual  and  Instruc- 
tions to  students  to  be  prepared  In  Block  III. 4. 

The  decisions  made  In  the  previous  section  on  determining  manage- 
ment guidelines  are  major  Inputs  to  the  System  Master  Plan.  Much  of 
the  other  Inputs  to  the  plan  are  also  already  available  from  other  parts 
of  this  block  and  other  blocks  In  the  Model.  It  should  be  ei nphaslzed 
that  the  SMP  developed  here  Is  a tentative  plan  that  most  likely  will 
be  revised  as  It  Is  put  Into  use. 

The  details  of  the  SMP  will  depend  largely  on  the  training  setting 
selected.  If  the  setting  is  the  RS,  the  principal  problems  will  be 
with  the  local  resources  and  instructors  as  well  as  with  the  factors 
already  mentioned  in  this  section. 

If  the  setting  Is  FOJT,  the  SMP  will  contain  much  of  the  same  infor- 
mation, but,  {n  addition  must  Include  all  of  the  additional  requlremjnts 
brought  about  by  the  location  of  the  trainees  in  areas  remote  to  the 
school.  For  example,  the  provisions  made  for  training  instructors  (FOOT 
supervisors)  will  necessarily  differ  from  the  arrangements  for  Instructor 
training  in  the  RS. 

Because  there  will  not  often  be  an  aggregated  staff  capable  of  pro- 
viding immediate  assistance  to  the  instructor,  the  manuals  and  other 
supplied  materials  will  need  to  be  in  a form  that  can  readily  be  used  on 
the  job.  The  instructor's  manual  should  be  in  the  form  of  a JDA  to  tr 
fullest  extent  possible.  There  should  also  be  a provision  for  the  FOJT 
instructor  to  be  able  to  talk  directly  with  the  course  manager  or  his 
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representative  in  person  or  by  telephore  in  order  to  resolve  problems 
which  arise  through  the  use  of  the  materials. 

Since  training  records  must  be  maintained  ir.  remote  locations,  some 
direct  means  must  be  established  for  keeping  the  records  of  training 
accomplishments  in  the  records  of  the  trainee.  Thus,  record  keeping 
becomes  as  Important  a part  of  FOJT  as  proper  administration  of  the  dPMs 
and  the  conduct  of  instruction.  If  the  course  Is  to  Improve  through 
time,  there  must  also  be  provision  for  evaluation  of  the  course  performance. 

Self-Teaching  Exportable  Packages  (STEPs)  can  become  an  Important 
part  of  the  FOJT  program  in  those  DOS  which  require  additional  media 
support.  The  SMP  should  take  into  account  which  of  the  tasks  or  terminal 
learning  objectives  will  be  served  directly  by  the  facilities  and  equip- 
ment found  on  the  job  and  which  must  be  served  by  the  STEPs.-  Discussions 
with  potential  FOJT  supervisors  should  be  an  important  part  of  the  plan- 
ning process  and  the  outcomes  of  these  discussions  should  be  given  care- 
ful weighing  In  the  final  decisions.  The  program,  the  STEPs,  and  the 
record  keeping  of  the  course  should  all  be  kept  as  simple  as  possible  to 
avoid  placing  an  unnecessary  burden  on  the  operating  units. 

If  the  course  is  to  be  offered  by  Installation  Support  Schools,  tl  e 
requirements  will  be  different  from  those  found  in  FOJT  cr  in  RS,  Since 
many  courses  offered  by  ISS  will  be  of  a temporary  nature  and  others  will 
be  of  an  infrequent  nature,  the  SMF  must  take  into  account  all  of  Jhe  » ■ 

resources  available  in  the  ISS,  the  needs  for  the  course  on  an  annual 
basis,  and  the  range  of  alternatives  available.  For  example,  i'  the  course 
is  offered  regularly  to  larger  numbers  of  trainees,  more  complete  packages 

i 
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of  learning  materials  can  be  developed  to  take  full  advantage  of  the 
chosen  media  and  stude.it  management  system. 

If  the  annual  requirement  Is  high,  it  may  be  reasonable  to  consider 
developing  a packaged  self-paced  course  suitable  for  offering  on  a con- 
tinuous basis  In  those  locations  where  facilities  permit.  Often, 

Learning  Resource  Centers  (LRCs)  will  be  available  where  all  forms  of 
multimedia  packages  can  be  used.  Other  locations  will  be  ve^y  hat'd 
pressed  to  use  anything  other  than  the  simplest  print  media  with  instruc- 
tor support  packages.  In  the  latter  cases,  the  quality  of  the  instruc- 
tor's manual  must  be  high  enought  to  achieve  the  desired  results. 

Preparation  of  SMPs  for  ary  setting  except  RS  will  require  con- 
siderable coordination  with  all  of  those  who  will  be  Involved  In  the 
use  of  the  course  package.  These  plans  should  bt  made  as  early  as 
possible  in  order  to  take  advantage  of  the  Inputs  *rom  the  full  range  of 
people  affected.  Most  often,  more  than  one  command  will  be  involved  and 
coordination  through  normal  channels  will  probably  take  longer  than  when 
everyone  Is  In  the  same  location. 

Many  exemplary  programs  exist  within  the  services  which  can  serve  as 
initial  starting  points  far  those  who  are  planning  a new  training  setting 
for  the  first  time.  The  Air  i'orca  lias  a well  established  and  procedural- 
lied  FGJT  program  whicn  is  a fundamental  part  of  the  Weighted  Airman 
Promotion  System.  Those  planning  Integrated  (FOJF,  IS5,  STEP)  training 
programs  could  benefit  from  careful  study  of  the  system  In  the  Air  Force. 

The  Army's  Training  Extension  Course  (TEC)  program  is  a very  good 
example  of  the  design,  development,  and  Implementation  of  STEPs  under  a 
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wide  variety  of  cu r cums tan ces.  These  lessons  used  In  the  TEC  program  cover 
a wide  range  of  DOS  and  topics  within  DOS.  They  are  In  audiovisual*  audio 
only,  and  printed  fcrnats.  depending  on  the  requirements  of  the  content 
and  the  Intended  use  in  the  field. 

Large  scale  ISS  training  for  critical  tasks  may  be  fcest  exemplified 
by  the  Nayy's  fleet  training  program  for  new  antisubmarine  warfare  (ASW) 
pilots.  This  program  utilizes  state-of-the-art  computer,  simulator, 
and  related  technologies  to  provide  introductory  training  for  a new 
weapon  system. 

While  there  are  many  other  notable  examples  of  well -managed,  exem- 
plary programs,  these  can  serve  as  a point  of  departure  in  those  instances 
where  the  problems  faced  by  the  developer  are  similar  In  nature.  Often, 
people  who  work  in  those  programs  are  familiar  with  other  similar  approaches 
used  elsewhere  and  can  provide  valuable  Information  for  further  search. 

3.0  OUTPUTS 
The  outputs  of  this  block  should  be; 

3.1  Products 

1.  Documentation  of  media  selected  for  each  learning  objective 

or  group  of  learning  objectives  (partial  example,  pages  14h  145). 

2.  A System  Master  Plan  which  provides  details  of  system 
decisions  on  how  the  Instruction  will  be  developed  and 
implemented 

a.  Instructional  management  plan  (See  example,  page  146.) 

b.  Plan  for  developing  instruction,  and 

c.  Plan  for  evaluating  the  system 


3 

3.2  Other  Documentation 

1.  Rationale  for  media  selection  decisions  and  management 
plan  decisions 

2.  A sunnary  statement  of  rationale  for  major  decisions 
in  the  System  Master  Plan 
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Media  selection  for  “remove  main  drive  shaft 
from  OH-58  Helicopter:" 


K . 


Laatnlng  Category  : 


positioning  movement. 

Li*ming  Activity 

1.  State  learning  activity 

<!.  Present  each  skill  separately 

3.  Provide  visual  demonstration 

<*-  Provide  checklist  and 
schematl  :s 

5.  Practice 

6.  Provide  KOR 

7.  Practice  until  job  standards 
are  reached 


M*dJi  Selection  Criierl* 


COMPLEXITY  CRITERIA 

OHicvtt  Motor  AcU .... - 

SftWK»#t  Motor  lo'rra^vc*  at  and  of 
Tralrtmf..  — — — ■ — . 

STIMULUS  CRITERIA 
Vfcual  F«th 

Aiphamimf  i* ■ 

factorial,  PUn# — 

Lift*  CoArtn^tto",  M**i* _ 

Oty*ct.  Solid— — 

Full  vtouai  iwo/urnm 
Visual  Movmrmu 

St  lit 

Lkrtltod — — ■ 

Full . _ 

VijutJ  Spectrum 

Block  **d  Whit* 

Gf«y  fciB—  ■■  — * 

CjlOf-  - — 

Seal* 

Ekoct  Sol*  ....  ......  ...  — 

A-idlo 

Volo*  Sound  Rang*— 

Full  Sound  Ranji  ■ . 

Ani*l*nt  Sound*  ■ . 

Ottu* 

T*ctil*  Cork* — ■ * 

lnt*m«l  Stimciut  Motion  Coa#  . ■ ■ . 

w«#rn*l  Stimuli*  Motion  Cum. 

Fin*  mou*n*nt  manipolatlva  Am 

Broad  MoM»m*;d  manipulative  Act* — 

TRAINING  SETTING  CRITERIA 

Individual  T *;na*  or  '**m  u fining  at  • 

FlK*d  Locution  — 

Individual  Train***  v*hh  *knultct*ovs 

instruction  or  tmnv  location*  - 

Individual  Train**  O'  team  training  with 
Indapandh.v.  intfru4«on  «t  any 

Location  — — 

Individual  Train**  on-th-  Job— 

Small  Group  ■ ■ ■ ■ 

L*rgt  Group  at  F.inpia  Location 

T**m  Salting , 

ADMINISTRATIVE  CRITERIA 

Sit#  Of  Court#**/*  Qavttopnwflt 
Local  — 

GtrUfut 

M*gnhud*  cl  A^*ui*)tion  Cott 

U*_ 

High 


M«jla  Pool 

i.  ' 

Operational  system  in  lab 

■’ 

with  tutor. 

Simulator  with  tutor. 

i- 

Procedure  trainer. 

Lab  carrel  with  equipment. 

T 

. 

Operational  system  in  real 

t' 

i, 

environment  with  tutor. 

1 

I' 

r. 

Madia  Selection  and  Ration*!*: 

All  acquisition  costs  are 
high  so  the  least  expensive 
of  the  above  should  be 
chosen,  the  operational 
system  in  real  environment 
with  Utor  should  be  used 
with  some  print  adjunctive 
materials.  If  a higher 
acquisition  cost  altern- 
ative .is  permitted,  the 
simulator  with  tutor  and 
tests  the  preferred 
choice. 


I 
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?UB- CATEGORY  9 

RECAUING  PROCEDURES  A1JO  POSITIONING  MOVEMENT 


To  chooit  a dtllMf/ 
system  i 

1.  Place  m ’J”  (light 
pencil)  In  bo<«* 
rtprtsahiinq  criteria 
(row*)  that  lust  be  Met. 

i.  select  the  delivery 
system*  (coluanal  that 
have  an  ,K"  in  each  row 
designated  by  a *J* ■ 
These  are  the  candidate 
.delivery  systems. 


Delivery  Approaches 
Pc  rm  1 1 1 »ng  the  A|  pi  I cat  win 
of  Ail  Learning  Guideline* 
and  Algorithm 


Criteria  for 
Selecting 
Instructional 
Delivery 
Sy ilea* 


Complexity  Criteria 

•Difficult  Mutur  Acts 


• Smooth  Motor  Performance  at 
End  of  Training 


stiauius  criteria 
•Vitus’  Form 


Alpha-Numeric 

Pictorial.  Plane 


Object.  Solid 
• V iaual  Movement 


Pull  Moveaen  t 


Voice  sound  Range 
Pull  Sound  Rang) 


Ambient  Sounds 


Tactile  Cues 

Internal  Stimulus  Motion  Cues 


Training  Setting  Criteria 
•Individual  Trainae  at  Plxed  Location 


> Individual  Train*  ' with  Independent 
Instruction  at  Any  Location 


• Sea  l i Group 

• Large  Group  at  Siiijia  Location 


i Tear*  Sotting 


Administrative  Criteria 

• situ  of  Courseware  and  special  Hard 
ware  Development 


• H ••|n  1 I ml  of  Acquisition  Co«‘. 
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CHAPTER  1 


m 
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TEC  GENERAL  INSTRUCTIONS 
FOR  THE  SOLDIER 

This  section  is  designed  tc  help  you  use  the  TEC  material.  We  have  tried  to  give  you  all  the  information  you 
need  to  get  the  most  from  TEC.  Use  the  following  list  as  a guide  to  ansv.er  your  questions.  For  more  information 
contact  your  supervisor  or  unit  training  NCO. 

• WHAT  IS  TEC? 

• WHOM  IS  TEC  FOR? 

• HOW  TEC  WORKS? 

• WHY  YOU  SHOULD  USE  TEC 

• HOW  TO  CET  STARTED 

WHAT  IS  TEC? 

TEC  is  a series  oi  presentations  designed  to  help  you  do  yout  job. 

The  first  series  (TEC  I)  was  a limited  production  program  produced  in  1972,  for  ihe  1 JB40  MOS.  It  is  no 
longer  in  production,  but  because  of  its  success,  1EC  has  been  enlaiged  to  provide  lessons  for  other  MOSs. 

Tite  thing  that  makes  TEC  different  is  that  the  lessons  have  been  tested  on  other  soldieis  to  insure  that  they 
teavh.  TEC  was  developed  to  make  it  easier  for  you  to  learn  what  you  need  to  know  and  whit  you  should  be  able 
to  do  in  the  performance  of  your  job. 

WHOM  IS  TEC  FOR? 

The  Training  Extension  Course  (TEC  II)  series  contains  information  for- 

• ali  soldiers.  These  a.c  called  common  subjects. 

• soldiers  in  the  four  combat  aims  branches  (Infantry,  Armor,  Field  Ai.Jlery,  ar.d  Air  Defense).  These  are 
called  branch  subjects. 

• soldiers  in  eight  military  occupational  specialties  (1  IB.  1IC,  I1D,  HE,  13A/B,  I3E,  16R.  16P).  These 
arc  MOS  subjects. 

The  TEC  III  series  contains  information  for- 

• soldiers  in  five  critical  duty  position  - 
Unit  Clerk 

PLL  Clerk 
TAMMS  Clerk 
Generator  Operator 
Radio-Teletypewriter  Operator 

The  TEC  IV  series  is  a continuation  of  TEC  II  & III,  and  adds  the  remaining  TRADOC  service  schools  to  'he 
program  to  uevciop  lessons  for  combat  support  and  combat  service  support  battalions.  TEC  IV  lessons  will  be 
fielded  in  FY  77. 
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MOW  TEC  WORKS 

TEC  materia1  will  be  presented  in  any  one,  or  a combination,  of  three  ways;  audiovisuaily  (like  a movie), 
audio-oni.  (like  a radio),  or  printed  (like  a book). 
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You  can  use  TEC  by  yourself  (at  your  own  speed)  or  with  several  of  your  buddies. 

\ttth  TEC,  you  study  only  the  lessons  you  need.  A test  belts  you  find  out  if  you  need  the  information 
presented  on  a particular  subject.  If  you  can  pass  the  test,  then  you  don't  need  to  take  the  lesson;  however,  you 
an-  free  to  use  the  lessor  anytime  as  a review  of  previous  instruction. 

WHY  YOU  SHOULD  l®£  TEC  AND  WHEN 

The  TEC  series  helps  you  in  the  following  ways: 

• TEC  provides  standardised  Instruction. 

• TEC  saves  time.  You  get  the  most  information  in  the  least  time. 

• TEC  teaches  what  you  nccd-to-know.  It  helps  you  prepare  fo.  your  Skill  Qualification  Test  (SQT). 

•TEC  prepares  you  to  do  your  job  bct'.er  or  learn  new  job  skills  which  increases  your  chances  for 
promo;  Ion. 

When  to  use  TEC 

•Prior  to  your  Skill  Qualification  Test  (SQT). 

• On  your  own  time 

• When  assigned  to  a new  job 
HOW  iO  GET  STARTED 

Lesson  Catalog- The  start  point  for  TEC  is  the  Lesson  Catalog.  Chapter  2 of  the  catalog  gives  the  objectives  of 
each  TEC  lesson.  A copy  of  the  TEC  Lesson  Catalog  is  in  your  unit  and  at  TEC  1 earning  Centers. 

Lesson  Administrative  Instructions  The  I esuon  Administrative  Insltuctiou  Is  a brief  outline  that  gives  you  the 
objectives  of  the  lesson,  skills  you  should  already  have  prior  to  taking  the  lesson,  and  a test  to  let  you  decide  if 
you  need  to  take  the  lesson.  It  tells  how  the  lesson  is  presented  (e.g.,  audiovisual,  audio-only,  programmed  text), 
and  additional  equipment  or  materials  required.  A copy  of  the  Lesson  Administrative  Instruction  Book  is  in  your 
unit  and  at  TEC  Learning  Centers. 

Student  Instruction  Sheet-This  is  an  abbreviated  l esson  Administrative  Instruction.  It  is  inside  the  box  of 
each  audiovisual  and  audio-only  lesson,  and  is  also  in  the  programmed  text  lessons.  It  is  a quick  reference  to  a 
lesson's  training  objectives,  materials  needed,  and  time  required  to  lake  the  lesson. 

Cne/Sce  Projector -This  projector  is  used  for  audiovisual  lc:sons.  In  most  cases  Cuc/Scc  projectors  will  be 
located  at  your  unit’s  Learning  Center.  Your  training  SCO  can  give  you  information  on  where  your  unit's 
Cue/See  projectors  and  TEC  lesson  library  are  located.  Learning  Center  personnel  will  show  you  how  to  operate 
the  projector.  Or.  you  may  take  the  “Introduction  to  TEC”  lesson,  which  teaches  you  how  to  operate  the 
projector  and  lei's  you  more  about  TEC 

Tape  Hay er  The  portable  cassette  tape  player  is  used  fo.-  audio-only  lessons.  Ihe  audio-only  lessons  are 
designed  to  provide  “step-by-step”  instructions  as  you  work  on  equipment  (e.g.,  a vehicle).  Your  training  NCO 
and  unit  Learning  Center  personnel  can  tell  you  where  the  tape  players  and  audio-only  lessons  are  kept,  and  how 
you  can  get  them. 

Programmed  Text-Some  TEC  lessons  will  be  presented  in  a book.  These  programmed  texts  are  available  at 
your  unit  or  at  TEC  Learning  Centers  just  like  audiovisual  and  audio-only  lessons.  In  some  cases  these  lessons  will 
be  formated  as  job  aids.  They  will  actually  provide  a simplified  checklist  to  pace  a man  through  his  jo),. 

Tit  thing  to  do  now  ii  to  decide  which  TEC  'estox  you  want,  or  need  to  take.  Head  for  your  unit's  TEC 
Learning  Center  and  give  TEC  a try. 
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FOR  THE  INSTRUCTOR 

Although  the  Training  Extension  Course  (TEC)  System  was  designed  to  be  used  by  the  individual  soldier  at  Irs 
own  pace,  it  can  also  be  used  in  the  small  group  mode.  This  section  implies  to  anyone  who  plans  to  adapt  TEC 
lesson,  to  the  group  mode. 

• THE  TEC  INSTRUCTOR 

• WHY  USE  TEC 

• HOW  TO  ADAPT  TEC  TO  YOUR  SITUATION 


THE  TEC  INSTRUCTOR 

TEC  places  you  in  a new  roie.  You  no  longer  just  present  information  to  a group  of  soldiers.  You  are  a 
manager  of  learning,  a res  ource  to  the  soldier,  a counselor.  Working  on  a more  personal,  individualize  J basis,  you 
will  help  the  soldier  broaden  his  skills  and  understanding,  take  steps  to  bong  his  performance  up  to  a standard, 
and  recommend  improvements  in  the  instructional  system.  In  order  to  achieve  these  objectives,  one  fundamental 
of  the  TEC  series  must  be  understood.  Each  soldier  must  demonstrate  mastery  of  the  skills  presented.  In  other 
words,  soldiers  are  not  being  compered  with  each  other,  but  with  the  standards  identified  in  the  TEC  lesson. 
Tests,  round  in  t!ic  LAls,  have  been  designed  to  assure  both  you  and  the  soldier  that  he  lies  reached  the  objectives 
of  the  lesson. 

As  you  know,  not  all  soldiers  learn  at  the  same  rate.  Some  soldiers  will  need  to  go  over  a lesson  several  times  to 
reach  the  objectives  and  standards  stated;  other  soldiers  might  feel  competent  and  request  to  take  the  test  prior  to 
studying  the  lesson.  If  they  can  pass  the  test,  they  should  not  take  the  lesson,  but  move  on  to  another  one.  in  the 
event  a soldier  f?i!s  the  test  and  does  not  perform  satisfactorily  after  retaking  the  lesson  several  times,  you  should 
identify  the  specific  items  which  are  causing  him  to  fail  and  make  direct  supervision  available  to  him.  But,  what 
about  the  soldier  who  finished  early?  What  can  be  done  to  maintain  his  motivation  and  interest?  If  his  reward  for 
finishing  early  is  ihe  assignment  of  another  lesson  nr  an  unpleasant  detail,  he  may  never  finisn  the  second  lesson. 
You  should  determine  a soldier’s  preferred  activities  (work,  play,  entertainment).  Then  upon  his  completion  of  an 
assignment  allow  a fixed  amount  of  time  for  him  to  enjoy  this  preferred  activity.  This  is  an  effective 
motivation-controlling  procedure  that  works  well  with  all  levels  of  soldiers  and.  in  addition,  is  usefjl  in 
controlling  the  behavior  of  less  motivated  soldiers. 

WHS  USE  TEC ? 

TEC  provides  you  with  up-to-date,  standardized  instructional  material  which  has  been  tested  to  insure  the 
stated  objectives  can  be  achieved. 

TEC  assures  on-the-job  performance.  By  passing  a TH‘  lesson  test,  'he  soldier  proves  he  can  do  that  portion  of 
his  job. 

TEC  assists  you  by  eliminating  much  of  the  research  requirement  for  class  preparation.  This  savings  in  time  can 
be  directed  toward  personalizing  you.  instruction. 

TEC  teaches  skills  that  are  critical  to  the  job  or  MOS  and  will  help  soldier*  prepare  for  the  SQT. 

HOW  TO  ADAPT  TEC  JO  YOUR  SITUATION 

The  steps  to  follow  in  using  TEC  lessons  in  rhe  group  mode  are: 

• Check  the  Lesson  Catalog  to  determine  what  lessons  are  available  that  apply  to  your  unit's  training. 

• Arrange  for  the  lesson  and  necessary  equipment.  Equipment  requirements  are  found  in  the  Lesson 
Administrative  Instructions. 
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• Tike  die  TEC  lesion  yourself  prior  to  presenting  it  in  the  group  mode. 

• Pretest  your  soldiers.  After  introducing  the  lesson  and  its  objectives,  give  the  test.  Soldiers  that  pass  the 
test  do  not  need  the  lesson. 

• Pace  the  lesson  to  allow  slower  soldiers  to  complete  exercises  during  programmed  stops. 

• Test  soldiers  again  at  'he  completion  of  the  lesson  to  insure  learning  has  occurred.  Those  who  have  not 
learned  the  objectives  should  repeat  the  lesson. 

In  some  cases  additional  practice  exercises  will  be  required  to  insure  that  your-  soldiers  can  perform  tasks 
presented  in  the  TEC  lessons.  These  are  called  "skill  practice".  Skill  practice  exercises  are  available  for  some 
lessons  to  assist  you  in  adapting  the  information  presented  in  the  lesson  to  a "hands  on"  practice  situation. 
Setting  up  this  follow-on  training  is  your  responsibility.  The  Lesson  Administrative  Instructions  help  you 
accomplish  this  by  either  referring  to  existing  exercises  contained  in  other  training  material,  e.g.,  Army  Subject 
Schedules,  or  providing  the  skill  practice  as  an  inclosure. 

FOR  THE  UNIT  TRAINING  MANAGER 

Training  managers  are  responsible  for  the  planning,  organisation,  conduct,  and  evaluation  of  training.  If  you 
are  the  Commander,  S-3,  Platoon  Leader,  Platoon  Sergeant,  or  Squad  Leader,  at  some  point  from  the  planning 
phase  through  its  implementation, >'6>u  will  play  an  impo-tant  part  in  the  management  of  your  unit's  training. 

• WHY  YOUR  UNIT  SHOULD  USE  TEC 

• HOW  TO  T.ET  THE  MOST  OUT  OF  TEC 

• YOUR  RESPONSIBILITIES  IN  IMPLEMENTING  TEC 

WHY  YOUR  UNIT  SHOULD  USE  TEC 

The  increased  individual  proficiency  resulting  from  the  use  of  TEC  w*U  improve  unit  proficiency.  TEC  v ill  also 
increase  the  soldier's  technical  proficiency,  resulting  in  better  job  performance  and  higher  SQT  scores. 

Because  TEC  is  standardized  instructional  material  (in  a media  the  individual  soldier  can  use  at  his  cwn  pace), 
you  will  be  able  to  direct  more  attention  to  unit  (collective)  training,  while  it  the  same  time  condu  ! effective 
individual  training.  For  example,  TEC  allows  you  to  single  out  squad-size  elements  from  other  Ira  ting.  Then, 
using  TEC,  the  squad  leader  can  develop  the  individual  proficiency  of  his  squad  members  to  the  required 
standards. 

NOW  TO  Gil  T THE  MOST  OUT  OF  TEC 

As  a training  manager,  your  responsibilities  include  the  appropriate  use  of  resources  to  achieve  a higher  level  of 
effective. less  or  a higher  level  of  efficiency,  or  both.  The  following  are  guides  to  assist  you  in  the  use  of  TEC  and 
help  you  achieve  your  mining  goals. 

• Insure  that  TEC  is  understood  throughout  your  unit.  Emphasize  that  TEC  is  a systematically  developed, 
tested,  training  program. 

• Build  TEC  into  your  training  program  (L«.,  select  and  schedule  TEC  lessons  for  the  individual 
proficiencies  which  relate  to  the  current  unit  training  mission). 

• Publicize  individual  proficiency  goals  and  use  TEC  to  train  to  the  required  standards. 

• Schedule  TEC  with  field  exercises  a concurrent  training.  Use  a make-up  and  inclement  weather  classes. 

• Encourage  the  use  of  TEC  to  assist  personnel  in  preparing  for  upcoming  Skill  Qualification  Tests  (SQT). 

• Make  TEC  available  during  duty  and  next-duty  bouts. 

6 


151 


* 


f 


I 


• Recognize  and  reward  individual:  who  use  TEC. 

<*  Do  not  'll!  a classroom  with  soldiers  and  attempt  to  use  TEC  as  you  would  a training  film.  Remember 
that  TEC  lessons  require  each  soldier's  active  participation  and  were  designed  to  be  used  by  an  individual 
or  adapted  to  a small  group. 

YOUR  RESPONSIBILITIES  IN  IMPLEMENTING  TEC 

As  a training  manager, you  have  the  responsibility  of  insuring  that  the  program  functions  properly. 

• You  must  supervise  the  use  of  TEC  equipment  For  example,  if  equipment  is  taken  from  the  Learning 

• Center  for  a platoon  class,  insure  that  it  doesn’t  erd  up  locked  in  a supply  room  for  several  days,  thereby 
limiting  its  use. 

• li.sure  security  of  all  TEC  materials. 

• Insure  completion  of  necessary  forms  and  records. 

•Schedule  locations  for  group  mode  presentations.  This  is  especially  important  in  assisting  soldiers 
preparing  for  Skill  Qualification  Tests  (SQT). 

• Schedule  tests  to  assist  in  determining  the  level  of  training  in  your  unit  and  to  identify  individuals  that 
would  benefit  from  TEC  training. 

• Schedule  activities  and  rewards  for  those  personnel  who  do  not  need  training  or  who  complete  the  YEC 
training  early. 


FOR  THE  COMMANDER 

Leadership  is  (he  basic  requirement  for  rhe  innovation  and  continuance  of  the  TEC  program  in  your  unit. 
Without  your  support.  TEC  will  fail. 

• DIVISION  COMMANDER 

• BRIGADE  COMMANDER 

• BATTALION/SQUADRON  COMMANDER 

• C OMPANY/ BATTERY/TROOP  COMMANDER 

ABOUT  TEC 

TEC  is  more  than  transporting  instruction  from  Army  service  schools  to  individual  soldiers  at  the  unit  revel  via 
multimedia  methods.  It  focuses  on  the  application  of  instructional  technology  to  all  types  of  Army  training. 

TEC'  training  materials  have  been  designed  to  emphasi/t  performance.  The  utilization  of  "tests " and  "skill 
practices'"  as  a part  of  the  TEC  program  is  in  step  with  the  Aimy's  move  toward  performance  oriented  training. 
Most  important,  these  materials  have  been  tested,  actually  “tried  out'"  on  soldiers  from  the  target  population  to 
insure  that  they  teach.  This  valida'ton  process  is  one  of  the  most  important  differences  between  the  TEC  program 
and  conventional  instruction. 

Your  commanders  and  trainers  can  use  (he  TEC  lesson  tests  as  a diagnostic  vehicle  to  deternvne  strengths  and 
weaknesses  in  the  job  proficiency  of  individual  soldiers.  A prescriptive  approach  to  training  can  then  be  taken  and 
you  will  be  able  to  profile  the  individual  proficiency  strengths  and  weaknesses  of  your  unit  as  a whole. 

The  TEC  training  materials  and  equipment  provide  'h?  nucleus  for  a unit  Learning Cen'er.  This  center  can  be  a 
composite  of  military  training  materials.  GKD  materials,  and  commercially  produced  materials  rela'ed  to  soldier 
needs  and  interests. 
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TEC  provide-  instructors  standardized  material  in  a ready  to-u-t  foun  adaptable  to  tlielr  needs.  The  instructor 
thus  will  have  more  time  available  to  concentrate  on  training  rathei  than  researching  and  pieparing  platform 
presentations. 

This  is  not  to  imply  that  TEC  is  the  answti  to  all  of  your  training  problems.  But,  TEC  does  give  you  another 
means  of  improving  an  Individual’s  proficiency  when  inlegrated  Into  your  training  program,  its  use  and 
tflectlvenss  will  be  limited  only  by  the  imagination  of  your  trainers. 
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CHAPTER  2 


TEC  MANAGEMENT  INSTRUCTIONS 
TFC  UNITS 

This  section  outlines  the  receipt  and  maintenance  procedures  to  be  followed  in  units  issued  tht  TEC  series.  In 
some  cases  the  procedures  for  Active  Army,  USAR,  and  National  Guard  units  will  differ;  these  dll 1 trence;  will  be 
noted. 

• RECEIPT  Of  Tec  lessons 

• SUPPORT  MATERIALS 

• RECEIPT  Of  TT.C  AUDIOVISUAL  EQUIPMENT 

• PREVENTIVE  MAINTENANCE 

• ORGANIZATIONAL  MAINTENANCE 

SUPPORT  MATERIALS 

Several  items  have  be:n  prepared  to  assist  units  in  the  effective  and  efficient  use  of  TEC. 

The  TEC  Lesson  Catalog,  TC  21-5-4,  lists  all  the  lessons  currently  available  in  th»  TEC  program.  Chaplet  2 of 
the  catalog  provides  a synopsis  of  the  training  objectives  for  each  lesson  to  assist  in  selecting  lessons  for  use  in 
accomplishing  specific  training  tasks.  The  catalog  will  be  distributed  down  to  company-sized  units.  Initially,  it 
will  be  produced  in  a loot-leaf  format  tc  facilitate  updating,  which  will  be  required  due  to  the  rapid  increase  in 
the  number  of  TEC  lessons  to  be  fielded  during  FY  76. 

The  Lesson  Administrative  Instructions  (LAI)  provide  the  following  information  for  each  lesson;  training 
objectives,  pretraining  actions,  lesson  materials,  equipment  and/or  materials  required,  length,  study  reference, 
skill  practice,  and  recommendations  to  instructors.  These  will  be  distributed  down  to  company-sized  units.  To 
assist  units  in  maintaining  accurate  files  of  LAIs,  a three-ring  binder  is  ilso  provided.  However,  the  unit  will  have 
to  supply  additional  hinders  as  their  lesson  inventory  increases.  TEC  suggests  that  LAIs  be  organized  and  filed  in 
the  binders  in  the  same  manner  as  Chapter  2 of  the  TEC  Lesson  f ’talog,  TC  2 1 -5  4. 

Adjunctive  Material  Is  required  to  support  some  lessons.  The  initial  issue  of  materials  will  accompany  the  TEC 
lesson  they  support  to  the  field.  Instruction  s are  provided  in  the  LAI  for  each  lesson  which  requires  adjunctive 
materials,  informing  the  unit  on  how  to  procure  replacement  adjunctive  materials  for  those  expended  during  the 
course  of  lesson  usage. 

Projection  Screens  are  issued  to  support  the  use  of  the  Cue/See  Projector  in  the  small  group  mode.  The  BOI  is 
one  screen  per  company. 

To  facilitate  control  and  easy  access  to  TEC  lessons,  Lesson  Storage  Cabinets  arc  needed.  Appendix  C shows 
plans  for  a lesson  storage  cabinet  easily  made  by  modifying  a footlockei.  One  advantage  of  this  type  oi  storage 
container  is  its  mobility.  With  it  the  unit’s  TEC  lesson  library  can  be  easily  transported  to  the  field. 

Whatever  is  used  to  store  TEC  lessons,  TEC  suggests  that  lessons  be  filed  according  to  Chapter  2 of  the  TEC 
Lesson  Catalog,  TC'  21-5-4. 

RECEIPT  OF  TEC  LESSONS 

The  basis  of  issue  for  TEC  lessons  is  given  in  appendix  A.  The  initial  distribution  or  a lesson  will  be  made 
directly  to  units  by  the  TRADOC  Training  Aids  Management  Agency,  Training  Material  Support  Division, 
Tobyharma,  PA  18466. 

Under  special  conditions,  some  units  may  require  additional  copies  of  a TEC  lesson.  In  those  cases, 
adjustments  in  the  basis  of  issue  for  the  units  will  be  made  upon  review  and  approval  of  f'ie  demand  data.  To 
initiate  this  action,  the  unit  submits  requests  for  additional  copies  of  a lesson  to  the  Training  Material  Support 
Division,  ATTN:  ATTNG-TA-P.  The  unit’s  supporting  TASnuvsc  will  assist  in  preparing  and  submitting  the 
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order.  DA  Form  4125,  Permanent  Retention  Film  Order  (replaces  DA  Form  1 1 172)  will  be  used  to  submit  the 
request.  .See  pppendi.v  D page  IK.  The  film  order  wilt  be  addressed  from  the  supporting  TASO/AVSC  to  the 
Training  Material  Suppor  Division.  The  “ship  to”  block  will  contain  the  requesting  unit's  address. 

Damaged  film  cartridges  and  tape  cassettes  will  be  r.  placed  on  a direct  exchange  basis  by  (he  supporting 
TASO/AVSC 

Units  ceri  ascertain  (ht  completeness  of  their  lesson  Inventor,'  by  checking  the  TEC  Lesson  Catalog  (TC 

21-5-4). 

RECEIPT  JF  TEC AUCIOVKUAL  EQUIPMENT 

Die  BOi  for  the  Cuc/£ee  P'ojector  and  Portable  t assette  Tape  Player  is  given  in  tppendix  B. 

CONUS  units.  Active  Am.y  and  USAR,  will  receive  TtC  audiovisual  equipment  from  their  supporting  TASO. 
OCONUS  units  will  receive  TEC  audiovisual  equipment  from  their  supporting  Audiovisual  Support  Center 
(AVSC).  National  Cuard  units  may  receive  TEC  audiovisual  equipment  front  their  state  USP&FO  or  from  their 
supporting  TASO/AVSC.  This  vill  depend  on  each  state’s  TEC  implementation  plan  and  the  arrangements  made 
with  the  supporting  TASO/AVSC. 

It  is  suggested  that  receipt  procedures  be  in  accordance  with  AR  710-2  and  that  DA  Form  2062  (see  appendix 
H,  page  IV)  be  used  to  record  the  equipment  issue. 

PREVENTIVE  MAINTENANCE 

Preventive  maintenance  is  the  systematic  care,  inspection  and  servicing  of  equipment  to  keep  il  in  serviceable 
condition,  prevent  breakdowns,  and  insure  maximum  operational  readiness. 

Only  personnel  assigned  to  (he  unit's  Learning  Center  will  perform  preventive  maintenance  on  TEC 
equipment.  Learning  Center  personnel  will  prepare  equipment  for  operation  on  a daily  basis.  Students  will  not 
perform  this  function. 

Learning  Center  personnel  will  follow  the  maintenance  procedures  provided  in  the  equipment  operating 
instructions  to  insure  the  proper  use  and  maintenance  of  TEC  audiovisual  equipment.  Preventive  maintenance  is 
limited  to  those  activities  listed  in  (he  operating  instructions  for  each  type  of  equipment. 

A DA  Form  2404,  Equipment  inspection  a.id  Maintenance  Worksheet,  will  be  used  to  record  equipment 
inspections  and  checkouts  for  each  system.  Only  those  shortcomings  and  deficiencies  which  car.not  be  corrected 
or  which  are  corrected  by  replacement  of  parts  will  be  recorded  on  the  form.  Equipment  with  uncorreclcd 
shortcomings  and  dc^ciem  ss  wilt  be  evacuated  to  the  supporting  TASO/AVSC  for  maintenance  suppori. 

ORGANIZATIONAL  MAINTENANCE 

Active  Army  unia  and,  when  feasible,  US  Army  Reserve  units  will  deliver  inoperative  equipment  to  their 
supporting  iASO/AVSC  for  repair.  If  the  TASO/AVSC  can  repair  an  ileni  on  the  spot,  (he  same  item  will  be 
relumed  to  the  unit.  If  on-the-spot  repair  is  not  possible,  an  operational  item  from  maintenance  float  will  be 
exchanged  for  the  defective  item.  The  DA  Form  2404  will  accompany  the  equipment  and  be  used  by  the 
TASO/AVSC. 

US  Army  keserve  units,  that  cannot  deliver  the  inoperative  equipment  to  their  TASO/AVSC,  may  ship  il.  The 
DA  Form  2404  will  accompany  each  item  shipped. 

National  Guard  units  will  evacuate  inoperrtive  TEC  equipment  in  accordance  with  their  state's  TEC 
maintenance  suppori  plan.  The  DA  Form  2404  will  accompan"  the  equipment. 

10 


1 


155 


■ 


CK'ONUS  units  will  deliver  or  ship  inoperative  equipment,  along  with  DA  Form  1404.  to  their  supporting 
AVSC  for  repair. 

TRAINING  AIDS  SERVICE  OFFICE  (TASOj/AUDIOVISUAL  SUPPORT  CENTER  < AVSCl 

I iiis  section  provides  guidance  to  the  TASO/AVSC  for  establishing  policies  and  operating  procedures  for 
control  and  maintenance  of  TEC  equipment  and  supplies. 

• RECEIPT  AND  ISSUE  OF  TEC  LESSONS 

• RECEIPT  OF  TEC  AUDIOVISUAL  EQUIPMENT 

• ISSUE  OF  TEC  AUDIOVISUAL  EQUIPMENT 

• PREVENTIVE  MAINTENANCE 

• ORGANIZATIONAL  MAINTENANCE 

• DIRECT  SUPPORT/GENERAL  SUPPORT  MAINTENANCE 
RECEIPT  AND  ISSUE  OF  TEC  LESSONS 

The  TKADOC  Training  Aids  Management  Agency.  Training  Support  Division  will  make  the  initial  distribution 
of  lessons  to  units.  They  will  provide  the  TASO/AVSC  with  a copy  of  the  shipping  document  of  the  lessons 
issued  to  its  supported  units.  This  listing  will  serve  as  the  TASO/AVSC*s  issue  confirmation  document  and  as  their 
checklist  to  control  TEC  lessons. 

Alter  units  develop  demand  experience  for  TEC  lessons,  there  may  be  requirements  to  make  adjustments  in 
the  number  of  lessons  issued  to  a unit.  Die  unit  will  submit  its  request  for  additional  copies  of  a lesson  to  its 
supporting  TASO/AVSC  (DA  Form  4125).  See  appendix  D,  page  18.  The  TASO/AVSC  will  assist  the  unit  in 
preparation  of  the  order  and  forward  the  request  to  the  Training  Support  Division,  ATTN:  ATTNG-TA  P,  for 
approval.  Upon  approval,  the  lesson  will  be  shipped  directly  to  ihe  requesting  unit  with  a copy  of  the  shipping 
document  to  the  TASO/AVSC  for  control  purposes. 

The  TASO/AVSC  will  receive  a limited  numbe,  of  each  TEC  lesson  to  use  in  replacing  those  unit  copies  that 
become  defective.  The  TASO/AVSC  should  maintain  a minimum  of  iwo  copies  of  each  lesson  in  stock  by 
reordering  copies  from  the  Training  Aids  Management  Agency.  Training  Support  Division.  DA  Form  4 1 25  will  be 
used  to  order  these  lessons.  See  anpendix  D,  page  18.  The  “ship  to"  block  will  contain  the  TASO/AVSC‘s 
address. 

The  Training  Support  Division  will  notily  the  TASO/AVSC  when  lessons  become  obsolete.  The  TASO/AVSC 
will  inform  the  supported  Active  Army  and  Reserve  Components  units  to  turn  in  the  obsolete  lessons.  The 
TASO/AVSC  will  dispose  of  obsolete  or  damaged  cartridges  and  cassettes  in  accordance  with  AR  108-5 

RECEIPT  OF  TEC  AUDIOVISUAL  EQUIPMENT 

Upon  receipt  of  TEC  audiovisual  equipment  from  the  Installation  Accountable  Officer  the  TASO/AVSC  will 
inspect  it  for  completeness  and  serviceability. 

The  TASO/AVSC  will  prepare  the  equipment  for  distribution  in  accordance  with  the  instructions  provided  by 
the  US  Army  Combat  Arms  1 ruining  Board.  Fort  Renning,  Georgia  31905. 

The  TASO/AVSC  will  also  receive  additional  TEC  audiovisual  equipment  to  be  maintained  at  the  TASO/AVSC 
as  a maintenance  float.  Generally  this  will  be  calculated  on  the  basis  of  10%  of  the  equipment  issued  to  supported 
units. 

ISSUE  OF  TEC  A UDIOVISUAL  EQUIPMEN1 

It  is  recommended  the  procedures  in  AR  7 10-2  be  followed  for  issue  of  the  Cue/See  Projector  and  the  Portable 
Cassette  Tape  Player. 
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It  is  suggested  the  TASO/AVST  utilize  Dm  Foim  20b 2 (sec  appendix  t,  page  14)  to  issue  TEC  audiovisual 
equipment  to  Active  Army  and  USAR  units;  and  aiso  lot  the  National  Guard  whether  it  is  issued  to  die  units  or 
to  each  state's  United  States  Property  and  Fiscal  Officer. 

The  basis  of  issue  for  TEC  audiovisual  equipment  is  established  in  appendix  B.  Tire  TASO/AVSC  will  not  loan, 
o",  an  indednite  or  extended  loan,  additional  hardware  to.  or  recall  hardware  from,  units  without  approval  of  the 
supported  major  unit  commander. 

PREVENTIVE  MAINTENANCE 

The  TASO/AVSC  will  schedule  and  record  maintenance  services  for  TEC  audiovisual  equipment.  Maintenance 
services  are  slated  in  the  Technical  Service  Manual  for  the  cassette  tape  player  and  the  Maintenance  and  Set  vice 
Manual  for  the  Cue/Sce  projector. 

TEC  audiovisual  equipment  in  Active  Army.  USAR  and  National  Guard  units  will  be  Scheduled  for 
maintenance  services  semi-annually.  The  TASO/AVSC  or  state  Maintenance  Officer  will  notify  lire  units  of 
equipment  scheduled  for  maintenance  services  by  serial  numbci. 

Maintenance  services  for  audiovisual  equipment  in  the  TASO/AVoC  maintenance  float  will  be  perfotmed 
quarterly. 

ORGANIZATIONAL  MAINTENANCE 

The  TASO/aVSC  is  responsible  for  organizational  maintenance  of  TEC  audiovisual  equipment.  Maintenance 
guidance  is  contained  in  the  Technical  Service  Manual  for  the  cassette  tape  player  and  the  Maintenance  and 
Service  Manual  for  the  Cue/Sce  projector. 

Active  Army  units  and  US  Amiy  Reserve  units  will  deliver  inoperative  equipment  u their  supporting 
TASO/AVSC  for  repair.  If  the  TASO/AVSC  can  repair  an  item  on-the-spot,  the  same  item  will  be  returned  to  the 
unit.  If  on-the-spot  repair  is  not  possible,  an  operational  item  from  maintenance  float  will  be  exchanged  for  the 
defective  item. 

US  Army  Reserve  units  unable  to  deliver  equipment  to  the  supporting  TASO/AVSC  may  ship  the  inoperative 
equipment  to  tlie  TASO/AVSC.  The  DA  Form  2404  will  accompany  each  item  shipped.  If  the  TASO/AVSC  can 
repair  the  defective  item  within  24  hours,  it  will  be  returned  to  the  unit.  If  tire  TASO/AVSC  cannot  repai/tlk 
item  within  24  hours,  an  operational  item  from  maintenance  float  will  be  shipped  to  the  unit  to  replace  the 
defective  item. 

National  Guard  TEC  equipment  beyond  die  repair  capabilities  of  the  stale  combined  support  maintenance 
shop  will  be  shipped  or  delivered  to  the  T ASO/AVSC.  The  TASO/AVSC  will  issue  an  operational  item  from 
maintenance  float  to  replace  the  .tern  tumed-in. 

After  equipment  is  repaired  at  the  TASO/AVSC  it  will  be  placed  in  the  maintenance  float. 

A one-time  issue  of  repair  pat  is  kits  for  the  Cue/See  projector  will  be  nude  to  the  TASO/AVSC  on  the  basis  of 
one  kit  per  ten  machines. 

Tlie  TASO/AVSC  can  obtain  repair  parts  for  ail  TEC  audiovisual  equipment  by  requesting  the  Purchasing  and 
Contracting  Office  to  submit  purchase  orders  according  to  the  Basic  Oidenng  Agreements  which  have  been 
negotiated  with  the  equipment  manufacturers  of  the  TEC  audiovisual  equipment.  Distribution  of  the  Basic- 
Ordering  Agreensents  is  to  the  TASO/AVSC.  The  TASO/AVSC  will  distribute  copies  of  tlie  Basic  Ordering 
Agreements  to  his  supporting  Purchasing  and  Contracting  Office  and  installation  consolidated  maintenance 
facility.  Further  information  can  be  obtained  by  contacting  tlie  US  Army  Combat  Arms  Training  Board.  Fort 
Benning.  Georgia  3 1 90S.  (AV  835-5277). 
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Equipment  beyond  i lie  re  pan  capability  of  die  I ASO."  AVSC  will  he  sent  lo  die  siippmting  combined 
maintenance  facility.  >n  die  manulacimei  <poi  die  liable  Oiileiiim  Agreement l.  Iho  csetvisc  .ti‘  lids  • •piion  is  ai 
die  discioiiun  <il  die  TASO/AVSC  anJ  is  dependent  on  die  availability  arid  losponsivenO's  of  l)S  'CIS  siippon  lioin 
die  einliliiiied  maintenance  facility. 

imm  / si  mm  runs  hum  svmm  r ma  is  tuna  m r 

TEC  aiiiliovi  .;ul  equipment  i oqui eing  maintenance  beyond  oigani/uimiiai  level,  m beyond  die  eapahiliiy  uf 
die  1 .'.;i  'VAV.SC.  will  he  handled  in  die  following  inannci. 

I lie  | ASO  AVSC  -viil  evacuate  inoperalive  items  still  under  niainlcmmcc  wairanly  u>  die  iiiaiiulaumei's 
inainleiiaiue  facility  Waiuriy  inrniiiiaiiini  can  he  obtained  by  contacting  die  US  Armv  ( timbal  Anns  I raining 
Hoard.  Ion  Henning,  Georgia.  (AV  x.15-527/1. 

TEC  audiovisual  equipment  I'oi  which  die  warianiy  is  no  longer  in  elfocl  will  be  evaeualed  lo  die  Class  I 
iiisiallaiiiin  cousolidaied  maiulenanee  laeilily. 

II  die  numieuuiice  laeilily  is  not  capable  ol  icpaiiing  an  item,  die  inoperative  cquipmcni  will  he  evaeualed  in 
die  inanufaclmoi'..  designated  maiulenanee  laeilily  in  die  following  tilunncr. 

•The  inslailaiion  consolidated  iiiuinlenance  laeilily  mud  request  coulracl  niainienance  support  through 
die  I’liichasing  and  Contracting  Office. 

• The  l'uichasing  and  Contracting  Officer  svill  prepare  a purchase  order  according  in  die  leuus  ol'  die  basic 
oidering  agreeiiiCiu, 

• 1 lie  inoperative  item  and  the  purchase  order  will  he  shipped  ro  die  iiiamit'aeiiner's  designated 
inaintviiaiiee  laeilily. 

• I lie  maim  lac  Hirer's  niaimeiianee  laeilily  repairs  the  item  and  returns  it  to  die  installation. 

TEC  audiovisual  equipment  deleiinuicd  lo  he  uneeonomieally  repairable  will  he  relumed  lo  die  TASO/AVSC. 
Hie  TASO/AVSC  will  notify  the  IIS  Army  Combat  Aims  Training  Hoaid  of  die  failure  and  icqttCM  replacement 
lor  die  equipment.  1 Ire  T ASO.' AVSC  will  follow  local  pu'cednres  for  turn-in  »*f  die  equipment  to  the  I’ropeily 
Disposal  Office 

NATIONAL  GUARD  MAINTENANCE 

Ibis  seciion  seives  as  a guide  for  die  State  Maintenance  Office i ill  establishing  policies  and  operating 
procedures  relative  to  the  niainienance  of  TEC  audiovisual  equipment. 

• MAINTENANCE/SUPPORT  STRUCTURE 

• PREVENTIVE  MAINTENANCE 

• ORGANIZATIONAL  maintenance 

AW,\n:\At\cf:/siimm  r stkiu  tum: 

It  is  recognized  dial  die  suppoil  capabilities  of  lire  organizational  maintenance  shops  within  a given  Male  will 
vary.  Some  organizational  uiaiiilenanee  shops  will  he  able  to  perform  the  prescribed  inaitveiiance  on  TEC 
audiovisual  equipment,  others  will  not.  In  some  stales  it  may  be  necessary  to  perform  all  TEC  equipment 
organizational  maintenance  al  die  Combined  Suppoil  Maintenance  Slurp,  because  of  this  variance,  specific 
maintenance  procedures  applicable  id  all  slates  cannot  be  picseribed. 

The  Stale  Maintenance  Oflicei.  allot  careful  consiueialion  of  his  stale's,  maiulenanee  capabilities,  will 
designate  which  facilities  will  play  ail  active  tole  in  the  maintenance  of  TEC  audiovisual  equipment  Wc  do 
recommend  dial  all  organizational  maintenance  simps  be  part  of  the  support  structure  lo  expedite  movement  of 
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TEC  equipment  to  and  ilom  the  units.  The  prim. in.  .onndeijtion  should  be  to  J'rec  the  units  fiom  us  many  of  the 
maintenance  (esponsibllitie?  j>  possible. 

PREVENTIVE  MAINTENANCE 

The  Organizational  Maintenance  Shops/Coinhincd  Support  Maintenance  Shop  will  perform  scheduled 
preventive  maintenance  services  on  TEC  equipment.  TEC  equipment  will  be  scheduled  fur  oigauizational 
preventive  nv'ntcnancc  service  semi-annually. 

Organisational  preventive  maintenance  for  audiovisual  equipment  in  maintenance  lloat  will  he  performed 
quarterly. 

When  feasible,  it  is  recommended  that  organizational  preventive  tnamteiVjtKe  be  accomplished  at  ihe  unit  h> 
preventive  maintenance  teams  fiom  the  Organizational  Main.ciutnee  Shops/Combined  Support  Maimenanec 
Simp, 

ORGAN!/. A TIONA!  MAINTENANCE 

Ihe  State  Maintenance  Officer  is  responsible  for  organizational  maintenance  of  TEC  audiovisual  equipment 
issued  to  the  National  Guard. 

In  planning  for  maintenance  support  of  TEC  audiovisual  equipment,  the  Stale  Maintenance  Office,  will  want 
In  locate  the  maintenance  float  to  insure  responsiveness  to  the  supported  units.  This  can  be  done  by  placing  the 
njntcnar.cc  tloal  a:  the  slated  Combined  Support  Maintenance  Shop,  or  due  to  unit  locations  and  the  fas'loi.s  of 
time  and  distance  may  require  positioning  lloat  equipment  at  several  organizational  maintenance  shops.  This  tv  pc 
of  arrangement  will  increase  control  problems  in  management  of  the  lloat  equipment,  but  will  increase 
lespotviveness  to  the  units. 

National  Guard  units  may  evacuate  inoperative  equipment  to  the  Organizational  Maintenance  Shop.  Ihe  DA 
l-'orm  d-404  will  accompany  each  item.  If  the  C.MS  can  repair  ihe  item  on  the  spot,  it  will  he  iclurncd  to  the  unit. 
If  the  OMS  cannot  repair  the  item  on  the  spot,  they  will  request  an  operational  item  from  maintenance  lloat  be 
exchanged  lor  the  defective  item,  and  deliver  it  to  the  unit. 

An  item  of  cqiiipir.-iit  beyond  the  repair  capahilits  ol  the  OMS  will  be  forwatded  to  the  stale  ('ond'ined 
Support  Maintenance  Shop.  If  the  state  C'SMS  cjnn  n repair  the  item,  it  will  he  forwarded  to  the  supporting 
IASO. 
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APPENDIX  A 


TYPE  UNIT 


TH  LI  SSON  HASIS  01  ISM.II. 

NUMBER  OF  LESSONS  8V  TYPE 


common 

BRANCH 

MOS 

CRlTICAl 
DUTY  POSITION 

Active  Auny  Combat  Arms 
Battalion 

1 

1 

i 

i 

Rose* vo  Components 
Combat  Arms  B Mahon 

2 

?' 

T 

1 

c'SAR  School 

7 

?' 

?' 

7 

USAR  7 1 dining  Division 

A 

4 ‘ 

4' 

A 

'An  Defence  Artillery  lesions  jtp  net  issued 

TLC  II 

Common  Lessons  I osson.s  applicable  It'  all  soldieis. 

Branch  Lessons  lessons  applicable  n>  snldicis  in  tin-  loin  cmntkil  nuns  ln„njies  (IiiI.iiiiiv  . \iin"i.  I ichl 
Aililleiy,  ami  An  Defuisc). 

Military  Occupational  Speciality  I MOS I Lessons  l essons  applii  ihlo  in  soldier  in  ilie  l\»IU>vs  mi;  \|<  )S  illi.  III. 
III).  IIL.  IM.  MB.  1 el-..  loK.  lop. 

TEC  III 

Crilka)  L)ulv  Position  Lessons  lessons  applicable  to  soldieis  in  tin.  lollowinp  jobs.  L 'ml  ( Ink.  1*1  I Clcik. 
TAMMS  Cleik.  Cencraloi  Opeinloi.  and  Radio  IVIelyt  ewiilei  Opcuioi. 

Tlie  projected  l >ljl  is  approx-malclj  ltd?  lessons  ar  the  eompleiion  of  lie  enneni  lesson  d.'seliipincni  pioyi.un 
in  PY  7o.  For  planning  proposes.  (lie  following  is  a breakout  <>(  (lie  mnnlii  > ol  lessons  b , type' 

• Common 200 

• Infantry  Branch  & MOS 60 

• Amur  Branch  & MOS 85 

• Artillery  Branch  & MOS 85 

• ADA  Branch  & MOS 80 

• Critical  Duty  Position I 15 

NOT/.  Cavalry  St/radrons  will  receive  both  Infantry  and  Armor  Krwnv  and  MOS  A tom. 

.As  an  example,  an  Active  Army  lufjnlry  Ballulion  will  icceive  approsimalei  * .>75  lessons. 

• I each  of  200  Common  lessons 

• I each  of  60  Branch  & MOS  lessons 

• I each  of  1 1 5 Oilical  Duty  Posilion  lessons 
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APPENDIX  B 


TEC  AUDIOVISUAL  EQUIPMENT 
BASIS  OE  ISSUE 


TYPE  UNIT 


NUMBER  OF  SETS  PER  UNIT 


Active  At  my  Combat  Arms 
Battalion 


CUE/SEE  CASSETTE 

PROJECTOR  TAPE  PLAYER 


8 4 


Reserve  Components  Combat 
Arms  Battalion 


8 


4 


USAR  Schools 


5 


1 


USAR  Training  Division 


3/Bde 


1/Bde 
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INSTRUCTIONAL  hLTHODS  AND  DEVICES 


AUDIO  ONLY  SYSTEMS 

AUDIO  DISC  PLAYBACK  SYSTEM  - An  audio  system  that  uses  a record  player 
and  sound  recorded  o»  a disc  (record)  that  may  be  played  back  upon 
request  by  a listen*.  . 

AUDIO  TAPE  SYSTEM  - An  audio  system  that  uses  a tape  recorder/reproducer 
to  record  sound  on  magnetic  tape  that  may  be  played  back  upon  request 
by  a listener.  (Reel  to  reels  cartridge,  cassette) 

TELEPHONE  CONFERENCE  SYSTEM  - A telephone  system  with  switching  matrix 
capability  that  allows  multiple  station  two-way  audio  communication 
at  two  or  more  remote  locations. 

f. 


AUDIO-VISUAL 

AUDIO  TAPE  WITH  PRINTED  MATERIAL  - An  audio  system  that  uses  a tape 
recorder,' reproducer  to  record  sound  on  magnetic  tape  that  may  be 
played  back  upon  request.  Printed  materials  such  as  texts,  work- 
sheets, PI,  schematics,  test  materials,  etc.,  used  with  audio  tapes 
offer  a yariety  of  tuning  applications. 

CLASSROOM  - TRAUITIONAL  - A classroom  designed  and  equipped  for  an 
Instructor  to  lecture,  lead  group  discussions,  conduct  paper  and 
pencil  tests  and  use  instructor  controlled  audio-vidual  aids. 

FILMSTRIP  PROJECTION  SYSTEM  WITH  AUDIO  - A sound  filmstrip  projector 
represents  a fanri'y  of  audio-visual  devices  using  single  frame 
visual  filmstrips  with  sound  on  magnetic  tape  or  records.  Visuals 
and  sound  :*ay  be.  manually  or  automatically  synchronized,  or  be 
completely  Independent  of  one  another.  Commercial  equipment  options 
Include  front  or  rear  screen  projection,  remote  and  stop  action 
capability,  and  cartridge  loading  models, 

FILMSTRIP  PROJECTION  SYSTEM  WITH  AUDIO  AND  ADJUNCT  EQUIPMENT  - A system 
for  presenting  Information  via  a filmstrip  projector  and  synchronized 
audio  tape  or  film  sound  track.  The  use  of  adjunct  equipment  with  the 
AV  media  provides  the  capability  for  a variety  of  “hands-on"  training 
tasks  to  be  performed. 

MOTION  PICTURE  PROJECTION  SYSTEM  - COMTOCIAL,  16MM  and  SUPER  8MM  FILMS  - 
A motion  picture  projection  system  implying  the  use  of  professionally 
prepared  commercial  16mm  or  $-8mm  sound  motion  picture  films  for 
training.  Appropriate  I6mti  or  S-8mm  projector  and  projection  screen 
are  included. 
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NOTION  PICTURE  PROJECTION  SYSTEM  - LOW  BUDGET  16MM  AMD  SUPER  8ft<  FILMS  - 
A notion  picture  projection  system  Implying  the  -se  of  locally 
produced  sound  notion  picture  films  for  training.  Such  films  are 
acceptable  for  training,  but  often  lack  the  professional  quality 
of  commercial  films.  Appropriate  16mm  or  S-8mm  projector  and  pro- 
jection screen  are  included. 

MICROFORM  WITH  INFORMATION  MAPPING,  AND  AUDIO  - The  theoretical  con- 
figuration of  a training  system  to  support  Individualized  Instruc- 
tion composed  of  mlcroimagery  in  an  information  map  format,  a 
microform  projector,  an  audio  tape  in  a cassette  and  an  audio 
cassette  playback  unit. 

INSTRUCTIONAL  KIT  WITH  INSTRUCTOR  - A teaching  kit  designed  for  specific 
subject  area  instructional  support.  Kit  allows  the  Instructor  to 
use  a varied  or  multi-level  teaching  strategy  approach  to  instruc- 
tion by  including  appropriate  visual  aids,  audio  tapes,  models, 
charts,  demonstrators,  reference  and  test  materials. 

INSTRUCTIONAL  KITS  FOR  TRAINEES  - A modular  instructiona1  kit  designed 
for  students  that  contains  all  material;  required  for  a segment 
of  instruction.  Kit  may  contain  programed  instruction,  audio 
visual  materials,  tools,  materials,  typical  samples,  reference 
materials,  and  testing  materials  as  appropriate. 

OVERHEAD  PROJECTION  SYSTEM  WITH  INSTRUCTOR  - A system  consisting  of  a 
horizontal  stage  projector  designed  to  use  a vertical  throw  for 
focusing  an  enlarged  transparency  image  upon  a projection  screen. 

An  operator  Is  normally  required  to  change  the  transparency  and 
furnish  verbal  commentary. 

SOUND  SLIDE  PROJECTION  SYSTEM  - A system  for  presenting  information  by 
wans  of  an  audio  tape  and  a series  of  synchronized  projected 
visual  slides.  The  use  of  adjunct  equipment  allows  the  system  to 
be  used  in  support  of  "hands-on"  training. 

TEACHING  MACHINE  - BRANCHING,  STILL  VISUAL  WITH  AUDIO  - An  instruction 
device  composed  cf  large  step  multiple  choice  programmed  instruction 
frames  (still)  with  synchronized  smund  and  a manually  controlled 
device  to  select,  sequence,  and  display  program  frames  in  an  order 
dependent  upon  the  trainee's  last  response. 

TEACHING  MACHINE  - BRANCHING.  STILL  AND  MOTION  VISUAL  WITH  AUDIO  - An 
instruction  device  composed  of  large  step  mull  pie  choice  P«>- 
graamed  instruction  frames  (still  and  motion)  with  synchronized 
sound  and  a manually  controlled  device  to  select,  sequence,  and 
display  program  frames  in  an  order  dependent  upon  the  trainee  s 
last  response. 
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TEACHING  MACHINE  - BRANCHING,  WITH  ADJUNCT  EQUIPMENT  - An  Instruction 
device  composed  of  large  step  multiple  choice  programmed  Instruc- 
tion frames  (still  or  notion  with  or  without  audio)  with  a Manually 
controlled  device  to  select  sequence  and  display  program  frames  In 
an  order  dependent  upon  the  trainee's  last  response.  Associated 
with  this  equipment  Is  a second  piece  of  equipment,  such  as  a mock up, 
which  Is  the  subject  of  Instruction  and  Is  operated  according  to 
Instructions  from  the  basic  teaching  machine. 

TELECONFERENCE  SYSTEM  - A telecommunication  system  that  allows  audio 

and  visual  two-way  communication  between  two  or  mote  remote  locations. 

TELEVISION  - CABLE  (CATV)  - A hybrid  CCTV  system  offering  selective, 
multiple  channel,  encoded  programing  to  cable  network  patrons. 

A typical  system  consists  of  a signal  receiving  antenna  system 
for  the  master  station  and  n«lay  of  amplified  signal  channels 
via  area  substations  to  system  subscribers.  Programming  may  also 
be  generated  and  transmitted  between  substations  offering  multiple 
options  for  conference  or  training.  Programs  are  encoded  for 
privacy  and  control  of  viewing  audience. 

TELEVISION  - CLOSED  CIRCUIT  (CCTV)  WITHOUT  FEEDBACK  - CCTV  without  feed- 
back is  an  electronic  transmission  system  for  images  and  sound  using 
a coaxial  cable  distribution  system.  System  design  Includes  one  or 
more  studios  or  control  rooms,  a signal  distribution  center,  and 
signal  distribution  cables  terminating  in  reception  areas  equipped 
with  receiver/monitors.  Off  air,  live  or  video  taped  programs  may 
be  used. 

TELEVISION  - PORTABLE  VIDEO  TAPE  SYSTEM  - A low  cost  video  tape  recording 
and  playback  system  which  is  sol f- contained  and  portable.  Typical 
systems  consist  of  one  or  two  mobile  vidicon  cameras,  a small  scan 
video  tape  recorder  (SAW)  and  a monitor  receiver.  Immediate  area 
programming  and  open  broadcast  reception  and  recording  is  standard. 

CARREL  - AV  EQUIPPED  - A small  enclosure  or  alcove  incorporating  a desk 
used  for  Individual  studies,  supplied  with  audio  and  visual  materials 
and  supporting  equipment. 

CARREL  - LABORATORY  - A small  enclosure  or  alcove  incorporating  a desk, 
to  be  used  by  one  or  two  trainees  and  equipped  with  a set  of  special 
tools  and  materials  for  carrying  out  a hands-on  learning  event.  It 
nay  Include  audio-visual  s>s  terns. 

COMPUTER  ASSISTEO  INSTRUCTION  (CAI)  - A form  of  Individualized  instruc- 
tion that  employs  a digital  computer  technology  to  manage  and  display 
information  to  a student,  accept  student  responses,  provide  knowledge 
of  results,  and  select  subsequent  learning  events. 
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COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV  BASIC  CONFIGURATION  - An 
Indl vitalized  computer  based  teaching  system  being  developed 
by  the  University  of  Illinois  at  Urbana-Cnampaign,  and  Includes 
up  to  40 96  terminals,  a communication  network,  a central  computer 
and  the  author  language  TUTOR. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV.  BASIC  CONFIGURATION  AND  AUDIO  - 
System  Includes  basic  configuration  of  PLATO  IV  plus  a random  access 
audio  playback  system. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV,  BASIC  CONFIGURATION  WITH 
ADJUNCT  EQUIPJCNT  - Includes  the  basic  terminal  with  externally 
connected  auxiliary  equipment. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV  BASIC  CONFIGURATION  WITH  ADJUNCT 
EQUIPMENT  AND  AUDIO  - The  basic  terminal  with  externally  connected 
auxiliary  equipment  Includes  a random  access  audio  playback  system. 

COMPUTER  MANAGED  INSTRUCTION  (CM I)  - A computer  has  the  required 
Instructional  design  program.  It  can  receive  information  about 
the  student  behavior  from  terminals  on-  or  off-line  and  give  him 
Information  about  his  achievement.  The  design  normally  gives 
Instructions  for  changes  which  are  indicated  by  student  response 
and  may  drop  him  to  easier  exercises  or  automatically  cycle  him 
to  a higher  response  exercise, 

CHI  - CAI  TicciT  - A system  designed  by  Mitre  Corporation  and  programmed 
by  Utah  State  University  which  can  Loth  manage  student  Instruction 
and/or  provide  full  Instruction. 


COMPUTER  SIMULATION 


COMPUTER  SIMULATION  - ON-LINE  - A trainee  station  equipped  with  a computer 
terminal  in  which  the  trainee  operates  in  direct  interface  with  the 
computer  as  part  of  the  program  loop.  By  his  inputs,  the  trainee 
determines  his  allowable  performance  parameters  and  discerns  the 
effect  of  his  Inputs  upon  the  system  being  simulated. 

COMPUTER  SIMULATION  - OFF-LINE  - A trainee  station  equipped  with  a 

computer  terminal  enabling  a trainee  to  select  a computer  simulation 
program,  enter  his  own  variables  (batch  processing)  and  run  the 
simulation  to  determine  the  performance  of  the  simulated  system 
under  a variety  of  conditions. 

GAME  - COMPUTER  SIMULATION,  SOLITAIRE,  WITH  VISUAL  DISPLAY  - Any  contest, 
governed  by  rules,  between  a single  player  and  a computer  with  visual 
attachments  where  the  contest  is  a dynamic  model  of  some  real  world 
system  or  event. 
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OPERATIONAL  EQUIPMENT  WITH  MANUALS  - A unit  of  operational  equipment  being 
used  for  Instructional  or  training  purposes  with  Its  supporting  tech- 
nical documentation  such  as  operator's  guides,  maintenance  manuals 
and  parts  lists.  May  be  an  electronic  black  box,  rifle,  or  truck. 
Usually  associates  with  Individual  training  leading  to  team  training. 

OPERATIONAL  SYSTEM  - REAL  ENVIRONMENT  - An  operational  system  used  for 
training  such  as  an  aircraft,  ship,  or  track  vehicle.  Part  task, 
full  task,  sub- team,  team,  or  multi -team  training  may  be  conducted 
in  conjunction  with  or  Independent  of  normal  operations.  A per- 
formance aid  Is  inherent  In  trainer  usage. 

OPERATIONAL  SYSTEM  - SYNTHETICALLY  SIMULATED  - A device,  machine, 

apparatus,  or  paper  model  that  synthetically  reproduces  a condition 
or  conditions  of  an  operational  system.  It  may  or  may  not  physically 
represent  the  operational  system,  but  will  functionally  allow  an 
Individual  or  crew  to  practice  operational  tasks  In  accordance  with 
training  objectives. 

OPERATIONAL  SYSTEM  - SYNTHETICALLY  STIMULATED  - An  operation  system 
that  Is  used  for  training  by  Interfacing  input  equipments  in  the 
form  of  tapes,  black  boxes,  or  computers.  Such  Input  equipments 
present  programmed  data  to  the  operational  system  allowing  It  to 
be  used  for  training  or  evaluative  purposes.  May  be  used  for  part 
task,  full  task,  sub-team,  multi-team  training,  or  combinations 
thereof.  A performance  aid  Is  Inherent  in  trainer  usage. 

PROCEDURE  TRAINER  - Training  hardware  designed  for  basic  training, 
familiarization  or  transition  type  procedure  training  for  normal, 
alternate,  and  emergency  operation  of  operational  hardware.  Trainer 
systems  respond  appropriately  to  trainee  inputs  but  to  a lesser 
degree  of  fidelity  of  performance  than  Is  required  for  simulators. 

May  be  used  for  various  combinations  of  part  task,  full  task,  sub- 
team, team,  or  multi -team  training. 

PROCEDURE  TRAINER  - ADJUNCT  DISPLAYS  AND  LOGIC  - Training  hardware 
designed  for  basic  training,  familiarization,  or  transition  type 
procedure  training  for  normal,  alternate,  and  emergency  operation 
of  operational  hardware.  Trainer  systems  respond  appropriately 
to  trainee  inputs  but  to  a lesser  degree  of  fidelity  of  performance 
than  is  required  for  simulators.  May  be  used  for  various  combina- 
tions of  part  task,  full  task,  $id>-tean,  team,  or  multi-team  training. 
Adjunct  displays  and  logics  may  include  scoring  attachments,  adaptive 
control,  automatic  demonstrations,  enhanced  displays,  automated 
briefing  and  debriefing  capability,  automatic  coaching,  remedial 
exercise  prescriptions  or  follow-on  assignments. 
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SIMULA  t'CR  - Training  haninare  that  is  designed  specifically  tor  training 
purposes  to  simulate  operational  equipment/ systems  or  portions 
thereof,  and  which  simulates  the  operational  environment  In  a train* 
Ing  situation.  When  operated.  It  becomes  a dynamic  model  of  the 
appearance  and  performance  of  selected  aspects  of  the  operational 
equlpment/systera.  Hay  be  designed  for  part  task,  full  task,  sub- 
team,  team,  multi-teas’  training  or  combinations  thereof. 

SIMUALTOR  - ADJUNCT  DISPLAYS  AND  LOGIC  - Training  hardware  that  Is 
designed  specifically  for  training  purposes  to  simulate  operational 
equipment/ systems  or  portions  thereof,  and  which  simulates  the 
operational  environment  In  a training  situation.  When  operated. 

It  becomes  a dynamic  model  of  the  appearance  and  performance  of 
selected  aspects  of  the  operational  equipn*><it/system.  May  be 
designed  for  part  task,  ^cll  task,  sub-teem,  team,  .multi-team 
training  or  combinations  thereof.  Adjunct  displays  and  logics  may 
Include  scoring  attachments,  adaptive  control,  automatic  demon- 
strations, enhanced  displays,  automated  briefing  and  debriefing 
capability,  automatic  coaching,  remedial  exercise  prescriptions 
or  follow-on  assignments. 

SPECIMEN  SETS  - An  instructional  kit  containing  samples  of  similar  Items, 
liquids  or  materials  that  may  be  test* or  evaluated  for  identifi- 
cation, quality  or  type. 

PHYSIOLOGICAL  TRAINER  (HOSTILE  ENVIRONMENT) VISUAL  - A training  device 
designed  to  place  controlled  stress  on  the  human  visual  system, 
through  the  use  of  physiologically  and/or  psychologically  adverse 
or  low  threshold  visual  signals,  to  enable  a trainee  to  learn  to 
function  in  this  adverse  environment. 

PHYSIOLOGICAL  TRAINER  (HOSTILE  ENVIROfWENT)  SURFACE  AND  INTERNAL  SENSES  - 
A broad  category  of  training  devices  designed  to  provide  the 
cutaneous,  kinesthetic,  and  olfactory  sensors  with  physiologically 
and/or  psychologically  adverse  signals,  to  enable  a trainee  to 
function  In  adverse  pressure  temperature,  pain,  or  disorientating 
motion  envl ronments . 


VISUAL  ONLY 

FILMSTRIP  PROJECTION  SYSTEM  - A single  frame  projector  or  attachment 
thereto  that  will  accept  a filmstrip  format  and  project  the  film 
Images  upon  a viewing  screen.  See:  Sound  Filiretrlp  Projection  System. 

MICROFORM  WITH  INFORMATION  MAPPING  - Micro-imager/,  such  as  microfilm, 
used  as  a medium  of  Introduction  with  the  additional  requirement 
that  each  block  cf  Information  be  clearly  Identified  as  Introduction, 
overview,  test,  review  questions.  Index,  and  other  discrete  titles, 
and  that  each  type  of  Information  be  positioned  in  a standard 
location  within  the  medium  format. 
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MICROFORM  WITH  INFORMATION  MAPPING  AND  ADJUNCT  EQUIPMENT  - The  theoretical 
configuration  of  a training  system  to  support  Individualized  Instruc- 
tion composed  of  micro Imagery  In  an  Information  map  format,  a micro- 
form projector,  and  a piece  of  auxiliary  equipment,  such  as  a mockup, 
which  Is  the  subject  of  the  Instruction. 

SLIDE  PROJECTOR  SYSTEM  - 2“  X 2“  - A class  of  single  frame  pictire  pro- 
jectors that  will  accept  a standard  T X 2"  slide  and  project  the 
contained  Image  upon  a viewing  screen. 

SIMULATION  - PAPER  - The  representation  of  selected  dynamic  characteristics 
of  a system  through  the  use  of  charts,  tables,  static  photographs, 
drawings,  and  lists  of  performance  characteristics  under  specified 
conditions.  This  Information  Is  presented  In  such  a way  that  the 
trainee  can  study  the  initial  performance  of  the  system,  change  inputs 
to  or  elements  within  the  system  and  note  changes  In  the  performance 
of  the  system. 

TEACHING  MACHINE  - LINEAR,  STILL  VISUAL  - An  individualized  Instruction 
system  composed  of  a fixed  linear  sequence  of  small  step  programmed 
Instruction  frames  (still)  and  a manually  controlled  device  to  dis- 
play the  information. 

TEACHING  MACHINE  - BRANCHING,  STILL  VISUAL  - An  Individualized  instruction 
system  composed  of  large  step  multiple  choice  programed  instruction 
frames  (still)  and  a manually  controlled  device,  to  select  sequence 
and  display  program  frames  In  an  order  dependent  upon  the  trainee's 
last  response. 


PRINT  MATERIALS 

CASE  STUDY  FOLDER  - A folder  of  detailed  background  information  on  a 
problem  requiring  a decision  or  plan  of  action;  to  be  read  by  the 
trainee  prior  to  his  (l)  making  a decision  on  how  to  resolve  the 
Issue,  and  (2)  participating  in  a critique  cr.  various  solutions. 
Various  forms  of  folders  are  used  In  support  of  such  methods  of 
Instruction  as  +he  Case  Study,  Incident  and  In-Basket  methods  of 
management  and  leadership  training. 

FLASH  CARDS  - A set  of  cards  designed  to  be  used  by  an  Instructor  in 
front  of  a group  of  trainees  to  drill  the  group  in  the  recall  of 
menrry  type  information. 

PRINTED  MATERIALS  - HANDOUTS  - Handouts  are  a class  of  printed  materials 
issued  to  a student  for  his  use  and  retention  to  augment  regular 
Instructional  materials.  They  are  usually  Instructor  prepared, 
machine  copied  materials  of  one  or  two  pages  highlighting  specific 
topics  or  updating  existing  materials. 
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PRINTED  MATERIALS  - PERFORMANCE  AIDS  - Performance  aids  are  a class  of 
printed  materials  that  aid  In  job  performance  by  providing  data 
that  should  not  be  coomltted  to  memory,  such  as  checklist  routines, 
or  Is  too  complex  to  be  committed  to  memory  such  as  conversion 
tables,  equipment  test  tolerance  matrices,  and  the  like. 

PRINTED  MATERIALS  - REFERENCE  BOOKS  - Reference  books  are  a class  of 
printed  materials  used  to  Identify  certain  facts  or  for  background 
Information  such  as  dictionaries,  encyclopedias  or  technical  publi- 
cations. 

PRINTED  MATERIALS  - REFERENCE  CHARTS  - Reference  charts  are  a class  of 
printed  material  plctorlally  geographically  displaying  data  used 
to  Identify  certain  facts  or  for  background  Information.  Included 
are  data  charts,  schematic  diagram:,  topographical  maps,  and  the 
like. 

PRINTED  MATERIALS  - SELF  SCORING  EXERCISES  - Self  scoring  materials 
include  exercises  and  quizzes  used  in  conjunction  with  standard 
curriculum,  programmed  Instruction  or  independently.  The  class 
Includes  electrographlc  or  marie  sense  materials  scored  by  keys 
or  computer,  punch  mark  and  other  mechanical  score  indicating 
equipments,  chemically  scored  materials,  etc.  that  have  the 
capability  of  providing  near  inmedlate  student  feedback  without 
the  use  of  prolonged  scoring  procedures. 

PRINTED  MATERIAL  - WORKBOOK  - Workbooks  are  a class  of  printed  material 
used  to  augment  or  replace  regular  Instructional  texts  by  providing 
a mix  of  text  Information  and  practice  exercises  within  a single 
bock  or  manual . 

PRINTED  MATERIAL  - TEXT300K  - Textbooks  are  a class  of  printed  material 
dealing  with  a subject  of  study,  intended  for  use  at  a specified 
level  of  instruction  and  used  as  a principal  source  of  study. 

PROGRAMMED  TEXT  - BRANCHING  - A printed  text  containing  frame,  of  infor- 
mation and  multiple  choice  questions  concerning  the  information, 
organized  In  such  a way  that  the  trainee's  choir0  of  response  directs 
him  to  remedial  frames  or  advanced  material,  as  appropriate.  Thu 
material  is  carefully  sequenced,  tested,  and  revise!  to  ensure  that 
a specific  student  population  will  achieve  stated  *-ehavioral  objec- 
tives with  a predetermined  level  of  success. 

PROGRAMMED  TEXT  - BRANCHING  WITH  ADJUNCT  MATERIAL/EQUIPMENT  - Used  with 
adjunct  materials  or  equipment,  a wide  range  of  training  application 
is  available. 


■ PROGRAMME1)  TEXT  - LINEAR  - A printed  text  containing  a fixed  sequence  of 

small  frames  of  information  usually  in  the  form  of  questions  requiring 
the  trainee  to  construct  a simple  written  response,  which  is  immedi- 
i ately  evaluated.  The  material  is  carefully  sequenced,  tested,  and 

revised  to  ensu-'e  that  a specific  student  population  will  achieve 
f stated  behavioral  objectives  with  a predetermined  level  of  success 
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PROGRAMMED  TEXT  - LINEAR  WITH  ADJUNCT  MATERIAL/EQUIPMENT  - Used  with 
adjunct  material  or  equipment,  a wide  variety  of  training  appli- 
cation is  available. 

STUDY  CARD  SETS  - A deck  or  decks  of  cards  designed  to  present  training 
Information  to  an  individual  student. 


SPECIAL  AND  NON-STANDARD  ITEMS 

AUTOMATIC  RATERS  - INFORMAL  TRAINING  - A class  of  electro-mechi  lical 
response  rating  devices  used  primarily  for  Informal  refresher  type 
training.  Typically*  a gaming  anproach  Is  used  to  offer  multiple 
choice  type  questions  to  the  trainee.  Irradiate  feedback  upon 
answer  choice  selection  Is  giv^n  In  the  form  of  right,  wrong,  or 
Item  score  as  well  as  cumulative  score. 

CARREL  - DRY  - A small  enclosure  or  alcove  Incorporating  a desk,  used 
for  Individual  studies,  without  audio-visual  or  laboratory  equipment. 

DO-IT-YOURSELF  KITS  - A type  of  Instructional  kit  containing  Instructions 
and  materials  for  fabricating  a usable  product.  Such  a kit  offers 
practical  “hands-on"  training  following  theoretical  training. 

6Af€-MANUAL  SIMULATION  - Any  contest  between  teams  or  Individual  players, 
governed  by  rules,  where  the  contest  Is  a dynamic  model  of  some  real 
system,  and  Is  played  without  the  aid  of  a computer  using  gaming 
techniques. 

GAME  - MANUAL  NON-SItWLnTION  - Any  contest  between  teams  or  Individual 
players,  governed  by  rules,  where  the  contest  Is  not  a dynamic 
model  of  some  real  system,  and  Is  played  without  the  aid  of  a 
computer. 

GAME  - COMPUTER  SUPPORTED  SIMULATION  - Any  contest,  governed  by  rules, 
between  teams  or  Individuals,  where  the  contest  is  a dynamic  model 
of  some  real  system,  and  a computer  Is  used  in  performing  some  of 
the  calculations  necessary  for  the  operation  of  the  model  as  in 
computer  supported  war  gaming. 

LOGIC  TRAINERS  - A class  of  trainers  that  synthetically  allow  electronic, 
mechanical,  fluid,  or  gaseous  conceptual  system  logic  training  with- 
out the  use  of  actual  hardware. 

MQCKUPS,  PANELS,  AND  DEMONSTRATORS  - DYWAMIC  - A visual  training  aid  that 
allows  an  instructor  to  demonstrate  manipulative  principle,  movement 
In  time  o»*  space,  steps  of  a procedure,  linear  effect  within  systems 
or  changes  in  condition  of  equipment  or  systems  through  one  or  more 
operating  phases. 

MODELS  AMO  STATIC  MOCKUPS  - SMALL  SCALE  - A three-dimensional  training  aid 
built  to  scale  and  representing  operational  equipment.  It  may  be  a 
solid  or  cutaway  mode'  capable  of  disasscnbly  by  which  spatial  and/or 
sequential  relationships  are  represented.  Also  included  are  layout 
models,  recognition  model  sets,  and  terrain  ur  topographical  models. 
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MOCKUPS,  PANELS,  AND  DEMONSTRATORS  - STATIC  - A training  aid  used  to 
demonstrate  relative  shape,  size,  composition  or  function  of  an 
object  or  system  by  a visual -cognitive  process  performed  by  the 
trainee.  Such  non-moving,  real  or  "scaled"  aids  include  cutaway 
models,  diagrams,  blow-apart  hardware  displays,  etc. 
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APPENDIX  C 


DESCRIPTIONS  OF  VARIOUS  MANAGEMENT  PLANS 

I.  Student  Management  Plans 

Students  must  receive  information  and  guidance;  they  must  understand 
the  objectives  and  receive  feecfoacfc;  they  sometimes  need  motivation  and 
counseling.  The  instructor  is  ultimately  responsible  for  seeing  that 
activities  like  these  occur;  however,  the  instructor  Is  not  always 
responsible  for  actually  providing  all  of  these  activities.  This  can 
be  explained  better  by  looking  at  some  different  student  management 
plans. 

There  are  a variety  of  student  management  plans.  Some  examples 
are:  (1)  Instructor-managed,  (2)  contingency-managed.  (3)  peer-managed, 
(4)  computer-managed,  (a)  media-managed,  (6)  student  self-managed,  and 
(7)  coni>1  nation  plans.  The  instructor's  responsibilities  for  student 
management  can  be  different  under  each  of  these  plans.  For  example, 
under  an  Instructor  managed  plan  like  lecture/conference,  the  instructor 
would  have  a very  broad  student  management  responsibility;  on  the  other 
hand,  under  a computer-managed  plan,  the  computer  could  assume  many  of 
the  student  management  responsibilities. 

I I . Instructor-Managed  Instruction 

1.  Group  mode.  Instructor-managed  methods  of  instruction  in 
the  group  modt  Include  lecture,  conference,  demonstration,  stud/  assign- 
ment, etc.  These  methods  are  described  in  the  second  section  of  this 
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block  (Section  2.3.1).  The  Instructor's  student  management  responsibili- 
ties are,  of  course,  quite  comprehensive. 

2.  Individual  mode.  An  Instructor-managed  plan  In  the  Individual 
node  would  be  called  Instructor- tutorial . Although  Instructors  often  give 
Individual  attention,  courses  are  seldom  built  around  this  plan.  It  simply 
takes  too  much  Instructor  time  to  manage  each  Individual  student  through 
a course.  The  instructor- tutorial  plan  Is  used  when  the  priority  and 
criticality  o>  the  task  warrants  extremely  detailed,  closely  monitored 
instruction,  or  when  the  number  of  students  Is  very  small. 

III.  Conti ngency-Hanaqed  I ns  tructl on 

Contingency  management  is  giving  reinforcement  to  change  behavior 
or  strengthen  behavior  in  a ii  sired  direction.  A relnforcer  Is  a cue 
that  follows  a behavior  that  a student  was  engaged  In  and  makes  more 
likely  the  recurrence  of  that  behavior.  Proper  management  of  rein- 
forcers can  be  a significant  aspect  of  student  management. 

1.  Group  mode.  Reinforcement  often  occurs  In  group  Instruction; 
for  example,  teacher  praise  for  an  on-task  behavior,  letting  students  who 
uemonstrate  comprehension  leave  class  ecrly,  ate.  Careful  attention  to 
student  reinforcement  Is,  In  fact,  a valuable  group  leadership  technique; 
however,  It  Is  seldom  developed  to  the  point  where  It  becomes  significant 
In  the  overall  management  of  all  students.  Proper  use  of  this  technique 
requires  practice  and  adherence  to  a carefully  prepared  plan. 

2.  Individual  mode.  When  Instruction  Is  offered  in  the  Individual 
mode,  propc"  management  of  reinforcers  can  be  a significant  aspect  of  the 
management  of  students. 
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Reinforcing  events  must  be  given  to  students  at  the  right  time, 
and  must  be  tied  to  attaining  objectives  of  the  course.  Contingency 
Management  plate  should  be  considered  for  student  groups  which  are 
typically  unmotivated,  particularly  In  the  case  where  the  Instructional 
content  Is  not  motivating  In  Itself.  Two  main  problems  are  associated 
with  reinforcement:  Identifying  appropriate  reinforcers,  and  controlling 
them  in  the  Instructional  system. 

Two  sources  of  Ideas  for  Identifying  reinforcers  have  been  suggested-- 
need  satlsflers  (for  example,  knowledge  of  results),  arid  highly  probable 
behavior  (for  example,  talking  to  other  students).  Specific  reinforcers 
would  Include: 

Rest  periods  and  breaks. 

Passes . 

Freedom  from  disagreeable  details. 

Demonstrating  proficiency  to  othe>s  and  to  oneself. 

Since  a separation  frequently  exists  between  the  Instructional  system 
and  the  agency  responsible  for  the  housing,  feeding,  and  administration 
of  the  students,  many  of  the  significant  reinforcers  are  under  the  control 
of  the  school  cownander.  In  order  for  reinfcrcers  to  be  delivered  on  the 
basis  of  achievement  of  the  objectives,  they  must  be  under  the  control  of 
the  Instructional  management  system.  Staff  members  must  be  trained  to 
atinlnister  contingency  managed  systems;  some  research  has  shown  that 
untrained  staff  unknowingly  reinforce  undesirable  instead  of  desired 
behavior,  and  sometimes  give  re1nfi.rccrc-  away  free  Instead  of  making  them 
contingent  on  the  desired  training  objective  achievement. 
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Contingency  management  plans  have  boen  shown  to  h*ve  good  effects  In 
Instructional  settings  where  lew  aptitude  students  are  Involved.  Before 
Instituting  contingency  management  in  a course,  sev^ial  factors  should 
be  considered: 

a.  Have  the  reinforcers  been  established  as  effective  with  the 
group  In  question? 

b.  Has  the  Instructional  administration  been  given  the  authority 
to  control  the  contingency  management  plan  and  its  reinforcers?  If  not, 
this  authority  should  be  established.  When  authority  cannot  be  given  to 
control  reinforcers  which  would  occur  outside  the  instructional  setting, 
the  reinforcers  should  be  restricted  to  those  in  instruction. 

c.  Has  the  instructional  staff,  both  management  and  instructing, 
been  given  sufficient  training  In  contingency  management  to  make  the  system 
work?  If  not,  the  training  should  be  provided  before  the  management  plan 
is  implemented. 

Student  contracting  is  a method  often  used  in  contingency-managed 
instruction.  It  is  a management  technique  whereby  a performance  contract 
is  drawn  up  between  the  student  and  the  instructor.  The  contract  specifies 
exactly  what  the  student  is  expected  to  do,  and  what  rewards  he  will 
receive.  The  reward  is,  of  course,  contingent  upon  satisfactory  comple- 
tion of  the  contract. 

Contingency  management  plans  should  only  be  established  with  the 
guidance  of  trained  professionals. 
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IV.  Peer-Managed  Instruction 

The  plan  of  using  students  to  manage  other  students  has  been  success- 
fully Implemented  in  various  instructional  settings.  It  Is  most  often 
called  peer  tutoring  because  It  usually  involves  one  student  tutoring 
one  of  his  peers  (another  student). 

1.  Group  mode.  Peer  management  of  Instruction  In  the  group  mode 
seldom  occurs.  In  seminars,  case  study,  and  other  forms  of  small  group 
Instruction.  Individual  students  are  often  responsible  for  preparing 
group  presentations,  but  the  real  responsibility  for  student  management 
never  shifts  away  from  the  Instructor. 

2.  Individual  mode.  Peer  management  can  be  developed  Into  a 
unique  student  management  plan,  or  It  can  be  Incorporated  Into  any  self- 
paced  instructional  plan,  Including  one  which  uses  contingency  management. 
Since  peer  tutoring  Is  a method  of  demonstrating  one's  own  proficiency  to 
someone  else.  It  is  a motivational  as  well  as  a tutoring  system. 

In  peer  tutoring,  the  student  who  reaches  proficiency  instructs  other 
students  In  the  skills  or  processes  to  be  learned.  In  learning  job  per- 
formances, the  student  watches  as  an  advanced  student  or  an  instructor 
performs  the  job  duty  or  duties,  is  Instructed  to  perform  the  job  duties 
by  the  person  whose  job  performance  he  watched,  and  takes  proficiency 
tests.  After  passing  the  proficiency  tests,  the  student  becomes  an 
instructor  of  a third  student.  If  the  learning  situation  Is  organized 
by  objectives  in  a course,  the  student  who  masters  an  objective  can  be 
a tutor  for  the  student  who  is  beginning  this  objective  or  needs  help 
with  It.  Obviously,  this  method  Is  suitable  to  use  with  contingency 
management  as  the  motivation  described  in  displaying  proficiency. 


Peer  tutoring  Is  adaptable  particularly  to  medium  and  low  ability 
students,  and  in  a self-paced  setting  where  the  Instruction  is  highly 
structured.  /II  Individuals  who  tutor  should  be  previously  trained  to 
tutor,  and  instruction  should  be  spot-checked  as  a quality  control 
measure. 

V.  Computer-Managed  Instruction 

1.  Group  mode.  The  closest  thing  to  corrputer-managed  instruction 
In  the  group  mode  is  called  computer-assisted  instruction  (CAI).  In  CAI, 
the  computer  takes  over  many  of  the  administrative  functions  like  grading, 
record  keeping,  reporting,  etc.  More  advanced  forms  of  CAI  will  also 
monitor  student  performance,  construct  individual  tests,  etc.  In  both 
cases,  however,  the  Instructor  remains  the  primary  student  manager;  the 
computer  is  really  an  Instructional  aid. 

2.  Individual  mode.  The  slop  lest  set  of  procedures  followed  in 
using  computer-managed  instruction  in  the  individual  mode  are  testing, 
diagnosing,  prescribing,  and  reporting.  In  this  form,  the  student 
reports  to  the  computer  terminal,  signs  on  with  his  own  student  number, 
and  takes  a pretest  or  unit  test,  which  the  conputer  diagnoses  according 
to  preset  decision  rules.  A prescription  is  presented  for  the  student 
and  instructor,  describing  the  succeeding  step  for  the  student  based  on 
his  test  results,  and  at  specified  times,  reports  are  generated  for  the 
instructor  and  the  administration,  so  that  they  have  up-to-date  records 
on  all  students.  This  process  is  repeated  for  each  unit. 

In  the  computer-managed  setting,  the  instructor  is  still  an  important 
figure,  but  he  is  a resource  rather  than  a manager.  One  of  the  require- 
ments in  setting  up  a computer-managed  instruction  system  is  retraining 
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Instructors  In  techniques  that  will  i rap rove  the  Instruction  for  the 


students. 


Computer  Report  to  the  Student 

In  the  simulated  system,  the  student  signs  on  to  the  computer  terminal 
with  his  own  number,  and  the  report  that  Is  printed  out  to  him  Includes 
Identification  Information,  so  that  he  can  be  sure  he  Is  getting  the 
right  material,  and  an  assignment  including  sources  of  materials.  He 
gets  an  estimated  time  for  performing  the  assignment,  and  finds  out  how 
many  incentive  wilts  he  can  gain  on  this  lesson. 

Simulated  Report  to  the 

Student  (before  lesson) 


AFSN  NAME  COURSE  BLOCK  LESSON  INSTRUCTOR  DATE 

224726  frost, CP  PME  IV  A Hyyt,  RE  10/22/72 

Your  assignment  is  

i 

First  you  should  sign  on  to  a computer  terminal  and  read  lesson  5.  This  j 

will  help  you  improve  your  reading  speed.  Next  read  Chapter  6 on  elec- 
ts emission  in  the  electronics  textbook  TB  371.  Finally,  do  exer- 
cises 1-7  In  workbook  UB  3ABR324UM7.  j 

Estimated  time  for  this  assignment  is  1 hour.  1 

You  may  receive  1 incentive  unit  for  each  minute  saved  in  addition  to  j 

5 incentive  units  for  receiving  a score  of  80%  or  better. 


If  the  student  completes  the  lesson  successfully,  he  gets  a message 
like  the  one  below: 

Simulated  Report  tc  the 

Student  (after  lesson) 


AFSN  NAME  COURSE  BLOCK  LESSON  INSTRUCTOR  DATE 

224726  Frost, CP  Pf€  IV  A Huy  t,  RE  10/22/72 

You  have  achieved  a s*;ore  of  911  mastery  for  lesson  A,  Electron  Emission. 
This  Is  passing  and  merits  5 Incentive  wilts.  Your  assignment  was  com- 
pleted in  31  minutes,  a gain  of  29  minutes,  which  merits  a total  of 
29  incentive  units.  Incentive  wilts  earned  may  be  applied  to  any  of  the 
incentive  items  on  the  list  passed  out  to  you  for  this  course. 
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If  the  student  had  not  reached  mastery.  his  usessrge  would  have  read: 

“You  have  vecelned  a 782  score  for  lesson  A,  Electron  Emission. 
This  Is  falling.  You  seem  to  be  having  trouble  with  tills  material. 
It  is  suggested  that  the  following  people  in  your  class  may  be 
able  to  help. 

Creamer,  U.R. 

Yaegar,  P.H. 

Paul  * T.H. 

Troutman,  R.S." 


The  computer-managed  Instructional  plan  shows  self-pacing.  Individualiza- 
tion of  treatments  {for  example,  the  reading  t.eatment),  contingency 
mangement,  and  peer  tutoring  for  remediation. 

The  simulated  report  to  the  Instructor,  below,  shows  the  Information 
the  Instructor  has  on  all  students,  up  to  date.  Each  student  who  failed 
to  reach  mastery  on  the  first  try  (see  AF5N  323237)  was  given  a different 
‘reatment  on  each  successive  try,  illustrating  remediation  individuali- 
zation. 

Simulated  Monitoring  Report 

to  the  Instructor 


Huyt,  R.E . PME  IV  A 

Stannary 

Students  passing  = 14  Average  Mastery  Score  = 84 
Students  Who  Failed  to  Reach  Mastery  or  First  Try 
Name  AFSN  Average  Score 


Name 

Danner,  D.E. 


AFSN 

323237 


10/27/72 


Range  = 80  to  92 


Average  Time 


Student  Individual  Record! 


AFSN 

Treatment 

Rank 

Mastery  Score 

Time  Incentives 

Assigned 

Order 

P redl cted/Obtai ned 

Predlcted/Obt. 

Gai ned 

£73586 

1 

1 

91/88 

54/38 

27 

780538 

1 

1 

84/81 

48/ SO 

15 

220550 

1 

1 

88/82 

50/70 

5 

93559G 

1 

1 

88/92 

51/48 

17 
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Simulated  Monitoring  Report  to  the  Instructor  (continued) 


423903 

1 

1 

85/81 

49/64 

5 1 

323237 

4 

1 

81/78 

64/38 

0 1 

323238 

1 

2 

84/76 

47/48 

17  | 

4i7767 

4 

i 

81/84 

45/31 

H 
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Many  of  the  methods  In  this  computer-managed  plan  can  be  used  in  an 
Instructor-managed  plan,  but  the  varied  treatments,  and  tiie  prediction 
methods  cannot  be  economic, lly  done  by  humans  alone.  If  a computer  Is 
available  for  Instructional  purposes,  it  is  most  economical  to  use  it 
to  capacity,  and  most  efficient  to  use  techniques  for  improving  instruc- 
tion that  humans  cannot  readily  handle. 

VI . Media-Managed  Instruction 

Often,  many  of  the  student  management  activities  can  be  p repared 
and  then  communicated  to  the  student  through  a medium  or  a combination 
of  media.  Communication  media  can  seldom  take  the  place  of  the  instruc- 
tor as  completely  as  a computer  can,  but  broad  usage  of  media  for  student 
management  is  both  wide-spread  and  successful.  In  their  application, 
media  can  pei  form  any  role  from  simple  aids  within  any  of  the  previously 
described  plans,  to  a position  of  shared  management  responsibility,  or 
even  to  being  the  predominant  instructional  manage'-. 

1.  Group  mode.  The  use  of  media -managed  instruction  in  the  group 
mode  occurs  with  regularity  in  only  two  instances:  instructional  television 
(ITV)  and  group  simulation  activity.  The  ITV  technique  employs  open 
circuit  or  closed  circuit  distribution,  or  on-location  video  tape  playback 
to  carry  the  burden  of  instruction  to  a classroom  of  students.  Often, 
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what  one  might  consider  to  be  media-managed  Instruction  Is  really 
teacher-managed.  This  j true  wnen  ITV  Is  used  as  a resource,  much  like 
a printed  text  or  a student  handbook,  to  facilitate  the  Instructor's 
activities.  Group  simulation  activity  (though  sometimes  medi a-marvaaed) 

Is  most  often  ised  as  an  eld  under  another  student  management  plan. 

2.  Individual  Mode.  The  most  common  form  of  media-managed  in- 
struction Involves  the  use  of  print  media;  for  example,  workbooks,  course 
manuals,  course  guides,  programmed  texts,  textbooks,  etc.  These  print 
media  are  the  most  common  "manager"  of  instruction.  For  example,  a 
course  manual  usually  tells  the  student  what  is  expected  of  him,  where  to 
go  for  materials,  what  mechanical  and  electrical  media  sources  to  use,  how 
to  branch  or  review,  etc. 

Print-media  management  is  comonly  found  as  part  of  Instructor,  con- 
tfngency.  peer,  computer  and  self-managed  Instruction.  Its  advantages  of 
convenience,  portability,  low  cost,  rapid  access,  and  revlsaollity  con- 
tribute to  Its  central  Importance  In  instruction. 

VI I . Student  Self-Managed  Instruction 

In  this  management  form,  a student  is  provided  with  objectives;  the 
student  must  them  personally  Identify  everything  required  to  reach  tho^e 
objectives,  plan  his  own  learning  strategy,  and  manage  himself  through  the 

entire  process. 

This  is  not  a typical  managenent  plan  In  task  oriented  training,  and 
It  is  not  found  at  all  In  group  mo«e  •‘nstruction.  However,  for  high 
ability  students  in  Instructional  situations  where  attitude  and  problem 
solving  objectives  are  important,  self-managed  learning  can  be  refreshing 
and  rewarding. 
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VIII.  Combination  Plans 

It  was  previously  mentioned  that  the  use  of  print  media-management 
regularly  occurs  In  all  of  the  student  management  plans  described  here. 
That  Is  an  example  of  some  possible  combinations.  Elements  of  all  six 
plans  (Instructor,  contingency,  peer,  con^utcr,  media,  and  s?lf-managed) 
could  conceivably  be  used  In  combination  or  Individually  at  various  stages 
of  a course. 
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FIGURE  HI  .3:  Flowchart  o«  Block  EX .2:  SPECIFY  INSTRUCTION  MANAGEMENT  PLAN  AND  DELIVERY  SYSTEM 


BLOCK  III. 3:  REVIEW/SELECT  EXISTING  MATERIALS 
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OVERVIEW 


Developing  instructional  materials  is  both  costly  and  time-consuming 
Therefore,  it  is  essential  to  consider  the  usefulness  of  existing 
materials  before  committing  resources  to  new  development.  In  this 
block,  existing  materials  are  reviewed  and  evaluated  in  terms  of 
their  appropriateness  to  the  learning  objectives,  learner  character- 
istics, and  Selected  learning  guidelines  and  management  plan. 
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REVIEH/SELECT  EXISTING  MATERIALS 
1.0  INTRODUCTION 

This  block  In  the  ISO  model  <s  critical  in  terms  of  potential  time 
and  dollar  savings.  In  following  the  ISO  process  up  to  this  point, 
exactly  what  Instruction  is  needed  to  meet  the  training  goals  has  been 
specified.  In  the  next  block.  III. 4:  DEVELOP  INSTRUCTION,  the  procedures 
for  instructional  development  will  be  outlined.  But  that  omits  an  Impor- 
tant step.  Many  of  the  learning  objectives  that  must  be  trained  are 
already  being  trained  with  some  success . ISO  does  not  ignore  the  effec- 
tive lectures,  films,  and  textbooks  currently  In  use.  On  the  contrary. 
It  Incorporates  as  many  existing  materials  as  possible.  The  purpose  of 
Block  III. 3:  REVIEW/SELECT  EXISTING  MATERIALS,  is  to  retain  as  many 
existing  materials  as  possible.  This  means  that  in  the  next  block. 
Instruction  will  be  developed  only  for  those  learning  objectives  which 
were  specified  In  Block  III.l  and  III. 2,  but  for  which  no  adequate 
existing  learning  materials  can  be  located. 

Pricr  steps  in  the  ISO  process  have  led  to  the  development  of 
learning  objectives  (Block  II. 1),  the  description  of  student  entry 
behavior  (Block  II. 3),  the  selection  of  specific  learning  guidelines 
(Block  III.l),  and  the  selection  of  an  appropriate  management  plan  and 
delivery  system  (Block  I II. 2).  These  decisions  now  can  be  used  as 
criteria  to  help  determine  the  usefulness  of  existing  materials.  An 
overview  of  Block  III. 4,  DEVELOP  INSTRUCTION,  will  provide  some  Idea 
of  the  amount  of  tine  and  money  recessary  to  develop  new  Instruction. 

By  adopting  existing  Instruction,  or  modifying  it  as  necessary,  the 
cost  of  instructional  materials  can  be  reduced. 
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One  way  to  describe  the  process  of  selecting  and  reviewing  existing 
materials  Is  to  contrast  It  with  the  process  of  analyzing  existing 
courses  In  Block  1.4.  That  block  reviewed  the  course  development  docu- 
mentation and  asked,  "Are  the  proper  tasks  being  taught?"  In  this  block, 
Individual  pieces  of  instruction,  a single  lecture,  or  filmstrip,  are 
reviewed.  The  question  astad  Is  not  "Are  the  proper  tasks  being 
taught?"  but,  "Are  the  tasks  being  taught  properly?"  In  Phase  I the 
concern  was  with  the  gross  task  of  deciding  "what"  should  bo  taught. 

In  Phase  III,  we  have  'added  on  "what"  and  are  concerned  with  "how;" 
how  should  these  tasks  be  taught? 

The  difference  in  emphas*s  between  Blocks  1.4  and  III. 3 is 
reflected  in  the  source  references  for  each.  Block  1.4  requires 
Information  about  the  course,  its  development  and  validity.  Is  the 
content  bared  on  a recent  and  thorough  task  analysis?  What  were  the 
criteria  used  in  selecting  which  tasks  should  be  taught?  Wnat  are  the 
performance  requirements?  Block  1.4  evaluates  the  merit  of  an  entire 
course  on  the  basis  of  how  It  was  developed,  the  procedure  that  was 
employed.  The  evaluator  does  not  necessarily  need  the  course  materials 
in  hand  when  deciding  its  merits.  Information  describing  the  course 
development  and  effectiveness  Is  sufficient. 

In  this  block,  however,  you  evaluate  the  instructional  materials. 

The  concern  Is  not  with  where  the  material  comes  from,  only  what  it 
as  to  offer.  Here,  you  determine  its  suitability  to  the  program 
requirements  developed  in  previous  blocks. 
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Or.e  feature  of  this  block  is  that  the  instructional  materials  review 
is  nut  Mmited  to  military  sources.  Civilian  resource  centers,  such  as 
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university,  libraries,  and  city  or  industrial  training  centers  may 
hou^e  useful  descriptions  and  illustrations.  Thus,  the  search  required 
in  this  block  is  more  extensive  and  intensive  than  that  required  in 
Block  1.4. 

Basically,  the  review  and  selection  procedure  consists  of  evaluating 
promising  Instructional  materials  to  determine  if  they  are  appropriate 
to  the  objectives,  learner  characteristics,  learning  guidelines,  manage- 
ment plan,  and  delivery  system  selected  in  previous  blocks.  A perfect 
match  will  not  be  found,  but  materials  may  be  located  that  require  only 
minor  modification.  Both  modification  of  instructional  materials  to 
match  previously  made  decisions,  and  modification  of  previous  decisions 
to  match  existing  materials  will  be  discussed. 

The  steps  in  the  procedure  for  reviewing  and  selecting  existing 
materials  are  shown  on  the  flowchart  in  Figure  III. 11,  the  foldout  page 
at  the  end  of  this  block. 


2.0  PROCEDURES 

The  true  worth  of  any  instructional  material  is  its  effectiveness  with 
students.  Only  by  trying  out  instruction  on  a representative  sample  of 
students  will  you  be  able  to  determine  the  actual  value  of  the  materials. 
Ideally,  you  should  base  your  decision  of  what  to  use  as  is,  what  to  modify, 
and  what  to  drop,  on  the  basis  of  validation  data  from  such  actual  tryouss. 
Unfortunately,  empirical  evidence  is  rarely  available.  Therefore,  you 
will  have  to  conduct,  tryouts  yourself.  But  you  probably  rannct  try  out 
every  available  existing  unit  of  mate,  ial  to  determine  its  effectiveness. 


There  is  simply  too  much  available  material.  Select  the  best  material 
and  test  It  on  a sample  uf  actual  students.  The  procedures  for  this 
process  are  discussed  in  Bloctt  III. 5,  VALIDATE  INSTRUCTION. 


The  first  step  In  tills  procedure  H to  | | 1 — — 1 

locate  as  many  instructional  materials  relevant 

to  the  learning  obje.tive  as  practical.  ^ ZK — ^ 

Appendix  B (page  95)  rf  Block  1.1  is  e Hist  of 
some  possible  sources  for  materials.  These 

materials  need  not  have  been  designed  | ' M " ' ] 

for  classroom  use.  But  they  must  have 
a potential  for  Instructional  payoff. 

Materials  may  be  located  according  to  cheir  objectives.  Many  instruc- 
tional materials  developed  since  1970  will  have  been  developed  by  pro- 
cedures similar  to  those  in  this  morual , and  their  objectives  will  be 
documented.  Most  materials,  however,  will  offer  only  a title  and  perhaps 
a short  summary.  This  should  be  enough  information  to  indicate  if  the 
materials  may  be  "close  to  the  mark."  The  amount  of  material  to  be 
reviewed  may  be  too  extensive  to  allow  time  to  follow  up  on  materials  that 
do  not  sour.d  promising. 

It  is  difficult  to  determine  when  the  collection  process  is  complete. 
On  the  one  hand,  it  is  wasteful  to  collect  thirty  documents  only  to  dis- 
cc  ar  that  the  first  document  submitted  was  entirely  adequate.  On  the 
other  hand.  It  is  equally  wasteful  to  alter  drastically  the  first  iteu 
that  is  submitted,  when  the  thirtieth  item  ma"  be  acceotable  without 


2.1  Collect  Existing  Materials 
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modification,  Therefoie,  it  Is  advisable  to  collect  all  relevant 
Information  as  expediently  as  possible  during  this  stage  of  the  process. 
If  B»re  than  one  selection  is  found  that  appears  consistent  with  the 
objectives,  each  sho  ,ld  be  identified.  Subsequent  steps  in  this  block, 
or  in  the  validation  process  in  Block  III, 5,  may  prove  the  first  choice 
to  be  inadequate.  In  that  case,  consider  a second  or  third  choice. 

Only  through  validation  procedures  will  the  true  effectiveness  of  the 
materials  be  determined. 


2.2  Evaluate  Existing  Materials/Leamer  Characteristics 


The  next  steps  in  the  procedure  involve 
revlewino  each  segment  of  instruction  for  - 

its  appropriateness  to  the  ISO  process.  N- 

This  involves  an  evaluation  of  the  appro- 


priateness  of  each  segment  to  the  pre-  [~  | 

determined  learner  characteristics,  <C>N~<CV^' 

learning  guidelines,  delivery  .system,  ^ 1 1.  - 

and  management  plan.  ^ 

It  is  important  to  recognize  the  decreasing  precision  and  exactness 
required  of  materials  as  when  moving  from  learner  characteristics  to 
learning  guidelines,  to  delivery  system,  and  to  management  plan.  Ihe 
flexibility,  or  leeway  in  decision  making,  increases  while  progressing 
through  the  block.  Learner  characteristics  are  quite  specific.  1, 
material  are  not  prepared  for  the  correct  audience,  they  must  be  modi- 
fied or  dropped.  Learning  guidelines  are  a bit  more  flexible.  They  do 
not  provide  a step-uy-step  learning  sequence,  only  general  direction. 


They  are  as  their  name  Implies,  mere  guidelines.  The  delivery  system 
Is  even  mc.'e  flexible,  and  the  management  plan  more  flexible  still. 

Most  of  the  decisions  to  drop  or  modify  materials  will  come  early  in 
the  decision-making  process.  Very  few  materials  that  are  satisfactory 
In  guidelines  and  delivery  systems  will  prove  unsatisfactory  In  terms 
of  their  management  plan. 

Remember,  the  purpose  of  Block  1 1 1. 3 is  to  retain  as  many  existing 
material?  as  possible.  Instruction  that  Is  not  quite  adequate  In  Its 
present  fcrm  may  be  codified.  Consultation  with  media  specialists  will 
determine  if  appropriate  modification  Is  permissible  or  possible,  and  If 
so,  whether  modification  will  be  more  cost-effective  than  development 
of  new  instructional  materials.  If  it  <s  cheaper  to. develop  new  material 
drop  the  existing  materials.  Determine  the  most  cost-effective  alterna- 
tive for  meeting  objectives,  and  then  follow  through  on  it. 

2.2.1  Evaluate  Materials 

One  point  should  be  emphasized  here.  The  procedure  for  reviewing 
existing  materials  Involves  proceeding  from  criterion  to  criterion  for 
each  Item.  Do  not  go  through  100  items,  judging  their  appropriateness 
to  a predetermined  learner  characteristic,  and  then  review  them  all 
over  again  In  light  of  the  next  criterion.  Instead,  review  one  segment 
of  instructional  material  and  ask  if  it  is  useable.  Are  the  learner 
characteristics,  learner  guidelines,  delivery  system,  and  management 
plan  satisfactory?  If  not,  will  modification  be  cost-effective?  Make 
that  decision  before  reviewing  the  next  item.  Once  you  have  the  knack 
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of  evaluating  In  this  fashion,  you  will  be  able  t r make  a number  of 
suitability  decisions  simultaneously  while  reviewing  each  segment  of 
material . 

In  the  first  step  In  this  evaluation  process,  consider  the  charac- 
teristics of  the  learners.  This  topic  was  first  addressed  In  Block 
II. 3,  ASCRIBE  ENTRY  BEHAVIOR.  There  external  as  wel;  as  Internal 
requirements  were  considered.  What  are  the  ranks  of  the  student,  and 
how  long  have  they  been  In  the  service?  What  academic  credentials  or 
special  skills  do  they  possess?  What  are  their  aptitude  scores?  How 
much  experience  have  they  had?  How  well  do  they  read?  If  .ne  reviewed 
materials  do  not  corammlcate  to  this  type  of  person,  the  materials  will 
be  of  little  use.  For  example,  when  reviewing  materials  for  learning 
objectives  which  center  around  the  operation  of  intelligence  gathering 
equipment,  the  learner  characteristics  clearly  indicate  that  materials 
must  address  E4-E7‘s  with  a high  school  education.  If  you  review  a 
manual  on  the  operation  of  such  equipment,  find  that  It  satisfies  a 
great  many  of  your  objectives,  but  that  the  manual  was  written  for 
college  graduates,  there  is  a problem.  The  vocabulary  is  difficult, 
the  se.otenc  structure  complex,  and  the  technical  material  densely  packed 
with  new  and  difficult  factual  Information.  Although  it  would  take  empiri- 
cal validation  to  prove  It.  it  seems  a fair  bet  that  this  manual  Is  not 
suitable  to  the  characteristics  of  the  specified  learners.  When  a segment 
of  Instructional  material  is  nsul table  as  it  stands,  it  is  appropriate  to 
consider  modification. 
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2.2.2  Hake  Revision  Decision 

Materials  that  clearly  aatch  learner  characteristics  should  be 
retained  for  further  eva.u<.t1on  and  those  that  clearly  do  not  meet  them 
should  be  rejected.  Most  material' , however,  will  fall  somewhere  between. 
They  will  be  very  gooc,  but  not  quite  good  enough.  They  will  not  meet 
the  criterion  **f  suitability,  but  they  will  come  very  close.  These 
materials  cannct  be  rej» cted  out  of  hand,  but  neither  are  they 
acceptable  as  Is.  The  question  then  becomes  one  cf  modification. 

Are  these  materials  “close  enough"  to  meeting  the  criterion  that  it 
will  be  less  costly  to  modify  them  than  to  develop  new  Instruction? 

While  materials  modification  Is  expensive  in  terms  of  time,  money 
and  manpower.  It  Is  often  less  costly  than  developing  new  materials. 

The  finer  details  of  this  decision  will  require  a media  or  subject 
matter  expert.  The  broader  decisions,  however,  are  yours.  The 
following  guidelines  will  aid  decision  making. 

1.  While  It  is  extremely  difficult  to  add  to  non-wrltten 
materials  using  the  same  mode  of  presentation.  In 
such  a way  that  your  audience  "cannot  tell  the  difference" 
between  the  new  and  old,  it  is  very  easy  to  delete  material. 
Thus  if  modification  involves  deletion  without  addition. 

It  Is  usually  less  expensive  to  modify. 

The  next  question  is,  "Will  this  deletion  destroy  the 
Integrity  of  the  material?"  It  is  easy  enough  to  remove  one 
third  of  the  slides  from  a slide  presentation  or  delete  the 
last  half  of  a video  tape.  But  it  is  more  difficult  to  cut 
and  splice  flit  in  three  or  four  places  without  destroying 
the  continuity  of  the  visuals  and  commentary.  Some  films 
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may  not  be  modified  without  explicit  approval  In  writing 
from  the  consnand  responsible  for  production.  Often,  fc.ese 
approvals  are  not  given. 

2.  before  modifying  the  ■materials,  make  sure  there  Is  a long- 
time  use  for  them.  If  yours  1-  a short- term  non-crltlcal 
course,  you  may  consider  using  the  selected  materials  just 
as  they  are. 

3.  Consider  the  physical  condition  )f  the  ..iaterials.  have  they 
been  modified  before?  Few  non-print  materials  can  bear  more 
than  one  round  of  changes  without  losing  their  continuity. 
Printed  materials  can  be  rewritten  without  too  much  trouble, 
but  films  and  tapes  may  have  to  be  coiq>lrtely  re-recorded. 
Materials  must  be  classified  by  the  magnitude  of  alteration 
retired.  Those  requiring  only  minor  modification  should  be 
tagged  accordingly,  as  should  those  that  will  require  major 
changes . 

4.  A media  expert  must  be  consulted  for  ' final  judgment.  He 
knows  th?  technical  aspects  of  materials  modification,  and 
their  relative  cost.  However,  you  must  decide  which  materi- 
als are  worth  his  consideration. 

5.  A general  rtie  of  thunb:  The  more  "exotic"  the  mediun,  the 
more  expensive  the  alteration.  Printed  materials  are  not 

a problem,  filmstrips  are  easy,  audio  tapes  are  more  diffi- 
cult, videotapes  require  expertise,  and  color  film  with 
sound  Is  extremely  difficult.  Judge  accordingly.  The  more 
’’exotic"  the  medium  the  more  likely  that  medifi cation  will 
be  expensive. 
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In  summary,  folios'  this  general  procedure:  Review  a selection  of 
material.  Does  it  meet  the  criterion  of  suitability  '-nder  consideration? 

If  It  does,  It  Is  retained  and  If  It  does  not,  It  Is  dropped.  If  It 
comes  close  to  addressing  the  criterion  effectively,  consider  modifica- 
tion. How  extensive  an  alteration  will  be  required  to  make  It  usable? 

If  the  changes  are  not  too  drastic,  If  not  too  much  must  be  added  or 
deleted,  good.  Ask  a media  expert  If  the  cost  of  modification  will  be 
less  than  the  cost  of  developing  new  materla’s  to  cover  the  same  objectives. 

If  modification  Is  less  expensive,  retain  the  raterlal  for  further  evaluation. 
If,  however,  the  material  will  require  extensive  modification,  or  the  media 
expert  feels  it  will  be  less  expensive  to  develop  new  materials  to  cover 
the  same  objective,  the  material  under  consideration  should  be  dropped. 

Do  not  overlook  the  possibility  of  keeping  the  existing  materials  as 
they  are,  and  developing  adjunct  or  associated  .raterials  to  supplement 
them.  If  the  present  materials  are  satisfactory  for  most  si-uJants  but 
too  difficult  for  some,  development  of  remedial  materials  for  the  less 
advanced  students  might  be  a suitable  solution. 


2.3  Evaluate  Exi  .ting  Ma-terials/Learning  Guidelines 


2.3.1  Evaluate  Materials 


The  next  criterion  of  suitability  to 
apply  to  a unit  of  materials  is  its  appro- 
priateness to  the  learning  guidelines 
selected  In  Block  III.l;  that  Is,  to 
determine  to  what  degree  the  materials 
under  consideration  provide  the  specific 
learning  guidelines  sheeted  for  the  par- 
ticular (e:rning  oojectlres  under  consideration. 
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Following  are  some  guidelines  for  making  these  decisions: 

1.  Recognize  the  Halts  of  the  learning  guidelines  within  each 
learning  category.  They  do  not  offe-  a ready-made  formula 
for  Instruction.  They  are  guidelines,  nothing  more.  For 
exa^le,  they  do  not  provide  a step-by-step  iearping  sequence. 

They  ere  organized  In  a generally  jequential  fashion— progress- 
ing from  Informing  learners  of  objectives  through  testing  pro- 
cedures—but  they  do  not  determine  the  content  of  the  instruc- 
tional materials.  There  is  more  to  the  process  of  selecting 
or  designing  instruction  than  simply  matching  each  objective 
with  a learning  guideline. 

2.  Learning  guidelines  do  not  necessarily  address  Individ-  al  objec- 
tives. More  likely,  they  guide  in  the  development  of  Instruction 
for  groups,  or  clusters  of  objectives.  Therefore,  when  attempting 
to  "match"  existing  materials  to  the  learning  guidelines,  keep  in 
mind  a group  of  related  learning  objectives  that  require  the  same 
learning  guidelines.  For  example,  you  might  have  ten  learning 
objectives,  each  of  which  require  i dentifi cation  of  a different 
part  of  a helicopter.  Most  likely  all  of  these  "identify" 
learning  objectives  will  have  the  same  learning  guidelines. 

When  reviewing  existing  mateiials,  consider  how  well  they 
maten  the  learning  guidelines  for  the  group  of  learning  objec- 
tives, not  just  for  one  single  objective. 

3.  The  easiest  evaluation  to  make  is  probably  the  negative  instance 
It  (nay  take  some  time  and  several  viewings  to  decide  if  some 
materials  are  consistent  with  a learning  guideline.  But  it  iocs 
not  take  long  to  determine  that  one  Is  inconsistent.  Materials 
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tiiat  violate  the  guidelines  may  be  dismissed  immediately 
to  allow  more  time  to  concentrate  on  promising  materials. 

By  rejecting  negative  Instances  out  of  hand  you  can 
quickly  reduce  an  imposing  amount  of  material  to  a manage- 
able size. 

Select  those  materials  that  most  efficiently  cover  the  subject, 
that  most  efficiently  meet  the  objectives.  Some  materials  will 
cover  many  objectives,  but  will  aiso  include  materia',  that  either 
addresses  no  objectives,  or  addresses  objectives  that  you  have 
not  specified.  Such  material  is  superfluous  and  wastes  time. 

The  requirement  Is  for  materials  that  "say  It  all,"  In  terms 
of  the  objectives,  not  materials  that  "say  It  all,  and  Jien 
some."  Select  those  materials  that  will  require  the  least 
amount  of  modification. 

Docianent  the  search.  When  viewing  Iwo  dozen  items  of  materials 
on  the  same  subject,  the  point  is  reached  where  the  reviewer 
asks,  "have  I not  seen  this  before?"  He  probably  has  seen 
It  before.  If  he  has  not  kept  a checklist.  Different  materials 
that  are  practically  identical  may  be  reviewed.  The  vheckllst 
will  help  organize  the  review  of  materials  and  avoid  repeats. 

Keep  one  eye  on  the  learning  objectives  and  one  eye  on  the 
learning  guidelines.  The  guideline  statements  are  not  useful 
by  themselves.  They  are  useful  only  as  they  apply  to  the 
particular  objectives  the  materials  must  cover.  It  may  be 
helpful  tn  think  of  the  learning  hierarchy  developed  In 
Block  II. 1.  The  object  here  is  to  see  if  each  item  of 
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material  addresses  any  or  a'l  of  these  objectives.  Those 
materials  that  address  these  objectives  by  employing  the 
proper  learning  guidelines  should  be  retained  for  further 
consideration. 


EXAf.i 


Assume  Instruction  is  tn  be  developed  ir  military  hiscory. 

The  cluster  of  objectives  addres  ed  concerns  Amerlc  an  Naval 
Involvement  In  the  ^r  of  181?.  The  learning  category  most 
appropriate  to  this  c»uster  or  objectives  is  subcategory 
#6,  Recalling  2 idles  of  Knowledge.  Tirn  to  the  list  of 
learning  guidelines  appropriate  to  that  category.  It  lists 
the  characteristics  to  look  for  In  esch  item  of  existing 
Instructional  material  to  be  reviewed. 

Assume  you  have  located  a filmstMp  on  the  War  of  1812.  At 
Jils  leve1  of  specificity,  some  guidelines  require  more 
emphasis  than  others.  For  example,  #11  -efers  to  phasing 
out  pixxnpt*1  during  instruction  and  #18  to  self-pacing 
Instruction  for  different  learner  styles  and  rates  of  learn- 
ing. These  are  important  guidelines  for  conducting  instruc- 
tion but  they  do  not  necessarily  have  to  occur  during  each 
15-minute  filmstrip.  At  this  particular  point  in  the  total 
course,  you  may  want  maximum  prompts  or  minimum  prompts.  It 
depends  on  where  you  are  in  the  course.  Or  the  filmstrip 
could  be  one  media  option  within  a self-paced  instructional 
program.  Thus,  guidelines  #11  and  #18  seem  relatively  unim- 
portant when  this  specific  material  is  considered. 

But  lock  at  guideline  #2,  which  refers  to  key  words  and  units. 
This  Is  appropriate  to  a filmstrip  of  the  War  of  1812.  Some 
guidelines  refer  only  to  testing,  or  practice  sessions,  or 
even  to  rest  periods.  Review  each  segment  of  existing  material, 
whatever  form  or  length  it  may  have,  and  match  it  to  the  guide- 
lines. Determine  wnich  guidelines  art  critical  to  it  and  which 
are  not.  The  specific  material  will  determine  which  guidelines 
are  Important. 


By  following  the  procedure  used  in  the  above  example,  you  should  be 
able  to  determine  if  either  of  the  filmstrips  is  suitable  for  further 
consideration.  Also,  you  should  have  been  able  to  decide  which  of  the 
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several  was  best.  However,  If  several  filmstrips  appear  a reasonably 
good  natch  to  the  applicable  learning  guidelines,  keep  all  of  them. 

You  can  make  a final  choice  later. 

One  other  consideration  is  of  some  Importance  here,  and  Is  of 
considerable  Importance  in  the  next  section  this  blr'k.  It  concerns 
the  accumulation  of  modification  costs.  Some  of  the  materials  that 
have  been  earmarked  for  modification  here,  for  learning  guidelines, 
were  previously  earmarked  for  modil Ication  for  learner  characteristics. 
Therefore,  you  must  determine  the  cost  of  both  modifications  as  compared 
to  producing  new  materials  to  meet  the  same  objectives.  In  the  following 
section.  Delivery  System,  you  may  have  to  base  the  cos*  decision  on  the 
cost  of  three  modifications.  And  in  the  next  section,  Management  Plan, 
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ynu  may  have  the  cos*:  of  four  modifications  to  consider  against  the 
cost  of  developing  new  materials. 

] 1 

EXAMPLE  1 * 


Consider  the  filmstrip  on  the  War  of  1812.  You  determined 
that  the  vocabulary  was  a bit  too  advanced  for  the  intended 
learners.  You  consulted  a media  specialist,  and  were  In- 
formed that  the  subtitles  on  the  filnetrip  could  be  edited 
for  $50.  The  cost  of  developing  new  material  to  satisfy 
the  same  objectives  is  $500.  Sc  you  save  $450  by  planning 
to  edit  the  subtitles.  Now  you  evaluate  the  same  filmstrip 
in  terras  of  learning  guidelines.  Again,  the  materia1  is 
good,  but  not  quite  good  enough.  Adding  additional  material 
to  the  filmstrip  In  order  to  Improve  it  will  cost  $100.  This 
involves  the  addition  of  new  material  to  meet  the  unsatisfied 
guidelines.  But  you  have  already  earmarked  tho  material  for 
*50  worth  of  modification  in  the  previous  section.  Thus,  the  ^ 

total  cost  of  modification  at  this  point  is  $100  plus  $50,  or  | 

$150.  The.!,  is  still  less  expensive  than  developing  new  J 

materials. 
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Now  evaluate  the  materials  again,  this  tine  In  the  light 
of  the  selected  delivery  system.  *ga.1n,  It  Is  close  but 
not  close  enough.  Another  modification  Is  required.  This 
time  It  will  cost  $150.  Now  $300  has  been  accrued  in  modi- 
fication costs  since  beginning  the  analysis.  The  price  of 
developing  new  materials  Is  $500,  so  It  now  will  save  *200 
to  modify.  But  there  is  still  one  more  decision  to  make. 

Is  the  material  suitable  to  the  selected  management  plan? 

If  modification  costs  of  over  $200  are  incurred  at  that 
point.  It  <s  no  longer  less  expensive  to  modify.  If  modi- 
fication cannot  save  money,  do  not  do  it  unless  It  can 
save  time  when  time  Is  critical.  Develop  something  new. 


2.4  Evaluate  Existing  Materlals/Dellvery  System 
The  next  criterion  of  suitability  Is 
the  match  between  the  existing  material 
and  the  deliver?  system  selected  in  Block 
III. 2.  Take  all  the  materials  that  have 
been  retained  after  considering  their 
appropriateness  to  the  learning  categories. 

Examine  each  and  decide  if  it  does  or  d>es 
not  conform  to  the  preselected  delivery 
system,  the  medium.  Remember  that  here 
the  media  choices  are  very  flexible.  Suppose  the  selected  medium,  or 
delivery  system,  was  still-visual.  Several  options  are  available.  A 
series  of  slides,  a filmstrip,  an  actual  object,  a model,  a drawing,  an 
overhead  projected  transoarency,  all  be  -till-visual  experiences. 

A requirement  for  audio  could  be  a tape  recording,  or  just  the  soundtrack 
from  a film,  videotape,  or  s Vide- tape  presentation.  The  latter  is  a 
edification  and  will  be  discussed  next.  The  goal  of  the  search  is  to 
locate  materials  that  may  be  used  as  is,  without  alteration.  Only  if 
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the  search  has  failed  to  produce  tsable  '•as  Is"  materials  are  edifications 
nade.  However,  one  of  the  selection  factors  In  the  main  selection  was 
ccits^.  Therefore,  something  "free"  may  allow  c second  choice  to  become 
a first  choice.  Materials  should  not  be  modified  to  fit  a different 
media  selection  without  first  considering  changing  the  media  selection. 

Often  materials  can  be  quickly  and  effectively  transferred  from  one 
median  to  another.  The  rule  that  applied  to  "learning  guidelines"  does 
not  apply  here,  however.  In  fact,  the  rule  is  just  the  opposite.  The 
more  “exotic"  a medium  is,  the  more  media  it  can  be  broken  down  into. 

A simple  written  page  cannot  be  made  into  a slide  or  film  or  record. 

But  a color  sound  film  may  become  several  media,  "he  visual  aspect 
may  become  a series  of  photograph*,  slides,  or  transparencies  with 
little  difficulty.  The  audio  aspect  may  become  a tape  recording,  or 
record  or  printed  page,  or  radio  program. 

2.5  Evaluate  Existing  Material/Management  Plan 

The  final  criterion  of  suitability  is 
the  management  plan.  Collect  all  of  the 
materials  that  were  retained  because  of 
their  suitability*  witn  or  without  n»di - 
fication,  to  your  learner  cha. acteristics, 
learning  guidelines,  and  delivery  system. 

Review  eaot  to  detemine  wnether  or  not 
it  conforms  to  the  preselected  management 


plan.  In  most  cases  the  materials  will  be 

suitable  or  the  mrdifications  required  will  be  very  slight.  Th;s  is  due 
to  the  nature  of  management  plans.  They  are  designed  to  schedule  the 
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presentation-  of  materials  and  activities.  !'  the  existing  materials  do 
not  match  the  management  plan,  usually  the  management  pl«n  can  be  modi- 
fied to  fit  the  material.  There  are  a few  management  plan  details, 
however,  t^st  might  not  acccwwdcte  all  materials.  For  example: 

1.  Contingency-managed  Instruction  requires  that  materials  be 
broken  Into  relatively  small  units  of  content  so  that 
incentives  may  he  provided  to  shape  desired  learnlnq 
behavior.  Some  mediated  presentations  neither  provide 
Incentives,  nor  maintain  their  continuity  and  integrity 
when  broken  down  Into  smaller  units. 

2.  Self-managed  Instruction  gives  the  student  responsibility 
for  determining  his  own  educational  progress.  Materials 
that  provide  excessive  guidance  negate  the  purpose  of 
such  instruction. 

3.  Peer-managed  Instruction  presents  much  the  same  situation. 
The  purpose  of  this  particular  management  plan  is  to  have 
students  assume  the  types  of  educational  responsibility 
that  directive  materials  deny  them. 

In  practice,  there  are  very  few  situations  where  materials  will  not 
fit  a preselected  management  plan  “as  is."  The  few  that  do  not  should 
require  only  minor  modification  to  the  materials  or  the  maragement  plan. 
There  is  one  exception,  however.  The  cost  of  multiple  modifications . 

If  a piece  of  material  is  earmarked  for  modification  of  "learner  charac- 
teristics," "learning  guidelines,"  and  ‘’delivery  system"  already  a 
modification  in  “management  plan"  may  be  more  trouble  than  it  is  worth. 
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> 2.S  Hake  Required  Revisions 

{ These  procedures  have  produced  two 

% usable  groups  of  material.  The  first 

group  includes  those  materials  that 
have  b«en  adopted  “as  is"  and  the  second 
g*T)up  contains  those  that  require  modi  - 
fl cation.  The  materials  that  are  suitable 
■nay  be  pul  aside  f^r  later  inclusion  in  the 
course  of  studies.  The  materials  that  will 

require  modification  will  fall  Into  three  categories:  those  requiring 
additions,  those  requiring  deletions,  and  those  requ’ring  both. 

Ti.e  me'-erials  requiring  only  deletions  or  deletions  and  additions, 
should  be  sent  to  jiedia  expert*?.  Advise  those  experts  of  the  deletions 
required.  The  materials  that  required  only  deletions  may  be  set  aside 
for  later  integration  into  a course  of  study.  The  remaining  materials 
will  require  additions  only.  Developing  materials  is  covered  in  Block 
III. 4.  Once  the  additional  r.aterials  have  been  developed,  return  to 
the  media  specialist  and  nave  him  integrate  the  newly  developed  materials 
into  the  old  materials.  This  completes  the  work  in  the  block. 

3.0  OUTPUTS 

The  outputs  of  this  block  should  consist  of: 

3.1  Products 

1.  An  outline  sf;,tement  of  existing  materials  included  in  thf* 
compljtad  course. 

2.  A summary  statement  of  material  revision  activities  and  costs. 
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3.2  Other  Documentation 


1.  An  outline  statement  of  existing  materials  considered 
for  inclusion  in  the  course. 

2.  Rationale  for  material  selection  decisions. 


hui  „ .uiniui  i iiu  uui  ulii'  liiiiiJilUillliu  iiiiiUM  Hill  ILIdll 


Sample  outline  statement  of  existing  materials  Included 
In  completed  course:  0H-5v  Helicopter  Malntenance-- 

1.  Maintain  power  train  assembly 

A.  Assemble  tat'  boom 

1)  35  nm  slide  demonstration  "Assembling  the 
OH-58  helicopter  tail  boo^i" 

2)  Schematic  diagram  of  tail  rotor  gear  box 

3)  Exploded  view  of  tail  roto*  drive  shaft 

4)  Four  page  lecture  outline  “Assembling  tall 
rotor  g;jar  box" 

B.  Disassemble  tail  boom 

1)  35  ma  slide  demonstration  "Disassembling 
the  OH-58  helicopter  tail  boom" 

2)  Exploded  view  of  tull  rotor  drive  shaft 

3)  Still  photograph  of  disassembled  tail  boom 


Sample  summary  statement  of  material  revision  activities 
and  costs: 

1.  Maintain  power  train  assembly 

A.  Inspect  main  rotor  hub  assembly 

1)  35  mm  slide  demonstration  "Inspecting  the 
OH-58  helicopter  main  rctor  hub  assembly" 

Revision:  Delete  last  15  slides  of  a total 

of  60  slides. 

Cost:  No  cost  for  deletion 

2)  Five  page  lecture  “The  rotor  hub  assembly" 

Revision:  Record  on  audio  cape. 

Cost:  $.75  per  cassette 

B.  Disassemble  main  rotor  hub  assembly 

1)  Diagram  of  main  rotor  hti"  assembly  in 
Technical  Manual  55-1' 20-228-20 

Revision:  Double-sized  reproduction  drawing 
w'th  color  coding  of  blade  assenbly. 

Cost:  $.06  each  for  over  1,000 
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2)  16  mm  filmstrip  "Disassembling  the  OH-58 
main  rotor" 

Revision:  Rewrite  and  re-record  the  entire 
script. 

Cost:  $110.00.  rewrite;  $1.35  per  cassette, 
re-record 
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FIGURE  HI  .11:  Flowchart  of  Block  III  .3:  REVIEW/SELECT  EXISTING  MATERIALS 
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OVERVIEW 

If  there  are  no  existing  instructional  materials  that  can  adequately 
help  students  attain  mastery  of  the  learning  objectives,  or  only  parti- 
ally suitable  materials  are  available  and  these  must  be  revised,  it  will 
be  necessary  to  develop  new  instruction.  The  intent.  In  this  block,  is 
to  assist  the  instructional  designer  in  making  the  best  use  of  available 


production  facility  personnel  to  produce  instructional  materials. 


I 
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BLOCK  III. 4:  DEVELOP  INSTRUCTION 
1.0  INTRODUCTION 

In  Block  II. 1,  one  or  more  learning  objectives  were  derived  for 
each  task  selected  foi  training.  In  Block  Ill.l,  specific  learning 
guidelines  and  learning  events  were  identified  that  require  different 
instructional  treatment.  In  Block  III. 2,  a certain  management,  plan 
and  delivery  system  was  chosen  for  specific  learning  objectives.  In 
Block  III. 3,  existing  materials  i-ere  evaluated  in  an  attempt  to  meet 
! the  instructional  needs.  After  this  reviewing  and  selecting  from 

existing  materials,  one  of  the  following  two  conditions  probably 
exist: 

1.  There  is  no  material  already  available  that  can  ade- 
quately help  students  attain  mastery  of  specific 
learning  objectives,  or 

2.  there  is  only  partial  material  available  and  this  must 
be  revised  and  added  to. 

In  either  case,  new  instruction  must  be  developed.  The  develop 
instruction  stage  of  the  ISO  model  is  one  of  the  most  important  in  the 
entire  instructional  process.  This  is  the  point  at  which  all  the  pre- 
ceding analyses  and  planning  will  be  utilized  to  produce  the  actual 
instructional  products  such  as  printed  materials,  TV  programs,  lec- 
tures or  slides. 

The  development  of  instructional  materials  generally  requires  the 
efforts  and  skills  of  many  individuals  and  groups.  Some  of  these  are: 

1.  subject  matter  specialists, 

2.  media  specialists. 
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3.  production  staff, 

4.  writers , and 

5.  evaluators. 

Extensive  assistance  from  such  experts  will  be  required  In  developing 
various  types  of  Instructional  materials.  The  primary  purpose  of 
this  block  Is  to  give  specific  Information  on  ways  these  professional 
personnel  can  help,  and  to  outline  what  must  be  prepared  and  presented 
to  such  personnel  if  they  are  to  help  In  the  most  efficient  manner. 

More  specifically,  this  block  Is  Intended  to  help: 

1.  Identify  the  general  methods  used  to  prepare  Instruction 
that  will  neet  the  learning  objectives, 

2.  familiarize  you  with  standard  l^rms  used  by  production 
facility  personnel, 

3.  assist  In  giving  clear  Instructions  to  the  support  group 
so  they  can  best  help  In  achieving  the  goals, 

4.  try  out  the  developing  materials  so  the  quality  of  the 
final  product  can  be  Improved,  and 

5.  prepare  adequate  instructions  for  students  who  will  be 
studying  the  materials  and  Instructors  who  will  manage 
the  Instructional  program. 

The  steps  in  the  procedure  for  developing  Instruction  are  shown 
in  Figure  III. 12,  the  fold-out  page  at  the  end  of  this  block. 
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2.0  PROCEDUKES 


2.1  Identify  Instructional  Needs  and  Constraints 
Before  beginning  the  development  of  Instruction, 
you  will,  of  course,  need  to  know  exactly  what  you 
are  expected  to  accomplish.  In  ISD  developed 
courses,  a great  deal  of  valuable  Information  is 
available  at  this  point.  The  most  valuable  Items 
will  be  all  the  Learning  Objective  Analysis  Work- 
sheets used  to  document  the  major  outputs  of 
Blocks  II. 1,  -II.2,  II. 4,  III .1 , and  III. 2. 

The  Learning  Objective  Analysis  Worksheets  provide  the  following 
Information: 

1.  Learning  objectives 

2.  Learning  objective  conditions 

3.  Learning  objective  standards 

4.  Test  items  for  each  objective 

5.  Keference  to  the  task  or  elet;  "r.l  frwi  which  the  learning 
objective  was  derived. 

6.  '.earning  objertive  sequence  number  and  how  objectives 
were  structured 

7 Learning  category  and  sub-categories  for  each  objective, 
along  with  reference  to  applicaole  'earning  guidelines 

8.  Applicable  learning  activities  for  each  objective 

9.  Management  plan  and  delivery  system 

10.  Existing  instruction  selected 
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These  Learning  Objective  Analysis  Worksheets  give  most  of  what  is 


needed  to  begin  developing  Instruction.  Some  of  the  items,  such  as 
management  plan  and  delivery  system  not  only  provide  Information,  but 
also  are  constraints  under  which  you  must  work. 

In  addition  to  the  above,  information  will  be  needed  as  to  approxi- 
mate fund  allocation,  tire  constraints,  personnel  constraints,  facility 
and  equipment  constraints,  etc. 

Before  proceeding  with  the  development  of  instructional  materials, 
a final  check  should  be  made  to  Insure  that  required  resources  defini- 
tely are  available.  It  certainly  would  be  ill-advised  to  plan  for  a 
certain  format  of  instruction  and  then  find  that  resources  once 
thought  to  be  available  will  not  be  available.  The  only  alternative  in 
tnis  case  is  to  reanalyze  Input  data  and  choose  an  alternate  approach 
consistent  with  the  available  resources  and  existing  constraints. 

2.2  Identify  Available  Resources 

All  military  schools  have  aval lab  e 
some  kind  of  facilities  for  producing  in- 
structional materials.  Typically,  this 
Includes  a television  capability,  print- 
ing plant,  training  aid  facility,  and 
an  audio-visual  production  facility. 

Specialized  media  preparation  plants 
and  model  shops  may  not  be  available 
locally.  However,  the  local  unit  can 
help  make  arrangements  for  special  items 
when  they  are  required. 
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Obtain  copits  of  the  production  facilities  documentation  regard- 
ing development  of  classroom  instruction,  video  instruction,  audio 
instruction,  slide-tape  presentations,  demonstrations,  computer  appli- 
cations, and  any  other  additional  materials  of  this  type.  Local  regula- 
tions or  servicewide  regulations  may  exist  relative  to  the  acceptable 
format  *or  presenting  materials  for  processing.  Where  these  are  avail- 
able, be  sure  to  obtain  copies.  Host  of  these  publications  have  noc 
been  developed  within  an  Instructional  Systems  Development  Model  con- 
text. While  they  may  have  to  be  adapted  to  your  needs,  they  still 
should  prove  extremely  helpful. 

Find  out  how  -a  get  the  subject  content  into  a form  that  the  pro- 
duction facility  can  easily  use.  For  printed  materials  this  may 
include  length  of  typed  1'nes  permissible,  page  numbering  locations, 
etc.  For  audio  material,  a script  must  be  prepared  in  a format 
acceptable  to  narrators.  Visual  materials  require  storyboards,  num- 
bered lists  of  final  order  required,  and  an  idea  of  what  the  final  form 
will  be  -st<ll  slide,  filmloop,  video  tapes,  etc. 

Find  out  how  much  assistance  can  be  expected  from  the  production 
facility.  Get  as  much  information  as  possible  on  how  they  would 
suggest  developing  the  particular  instruction.  Production  facility 
personnel  require  that  ideas  be  presented  in  a form  they  can  under- 
stand because  that  is  what  is  used  as  '•he  basis  for  judging  their 
costs  and  their  requirement  for  experienced  personnel.  From  the 

I 

description  of  planned  new  instruction,  it  will  also  be  possible  for 
them  to  give  an  elapsed  time  estimate.  From  this  estimate,  you  may  de- 
} cide  to  accept  some  suggested  alternatives  thay  ma}  be  almost  as  good. 
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or  perhaps  better,  than  what  was  originally  planned.  Though  general 
alternatives  should  have  been  selected  in  block  III. 2,  there  are 
production  alternatives  as  well. 

The  following  list  provides  a general  description  of  the  functions 
of  production  personnel  who  likely  will  do  most  of  the  actual  develop- 
ment of  instructional  materials. 

1.  Media  Specialist  (Consultant).  Media  specialists  often 
oversee  and  direct  media  center  personnel.  The  media  specialist  is 
usually  knowledgeable  in  all  areas  of  media  selection,  identification 
of  unique  media  and  stimulus  characteristics,  feasibility  of  different 
media  for  various  instructional  purposes,  media  production  costs,  use 
of  hardware  and  accompanying  software,  and  location  r»f  media  software 
(re:  films,  tele/islon  programs,  etc.)  on  a wide  variety  of  subjects. 
The  media  specialist  may  be  particularly  useful  in  helping  to  find 
existing  materials  in  the  content,  areas.  The  media  specialist  also 
should  be  able  to  provide  valuable  suggestions  before  the  development 
of  first  draft  materials  has  begun  to  save  both  time  and  money. 

2.  Graphic  Artist.  Since  a large  portion  of  media  productions 
usually  involves  some  artwork  in  the  form  of  graphs,  charts,  diagrams, 
or  pictures,  the  artist  is  another  media  professional  whose  assistance 
will  be  valuable.  The  graphic  artist  can  usually  be  called  upon  to  do 
a variety  of  illustrates  of  different  sizes  from  small  pamphlets  to 
large  poster  size  artwork.  Most  artists  also  can  produce  various 
sizes  and  styles  of  printed  lettering.  The  graphic  artist  also  probably 
can  advise  or  give  suggestions  on  the  most  effective  way  to  visualize 
the  instructional  message  Usually  an  artist  is  capable  ot  producing 
sketches  in  rough  form  which  will  be  quite  suitable  for  the  p.’oduction 
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of  first  draft  materials. 

3.  Print  Specialist.  The  print  specialist  Is  skilled  In  the 
development,  arrangement,  ami  production  of  a wide  variety  of  print 
materials  ranging  from  pamphlets  and  brochures  to  books.  The  print 
specialist  can  assist  In  deciding  how  to  reproduce  large  amounts  of 
material  as  economically  as  possible  without  undue  sacrifice  of  quality. 
He  will  advise  on  the  feasibility,  cost,  arid  preparation  of  various 
types  of  artwork  In  either  color  or  black  and  white.  In  general  this 
person  should  be  consulted  on  any  matter  Involving  the  production  and 
duplication  of  printed  materials. 

4.  Photographer.  The  photographer  is  capable  of  handling  a 
wide  variety  of  picture  taking  assignments  and  is  versatile  In  develop- 
ing and  printing  pictures.  Much  creative  photography  is  done  In  the 
darkroom  rather  chan  with  the  camera;  therefore.  If  any  special  photo- 
graphic effects  are  needed,  discuss  it  with  the  photographer.  It  would 
be  helpful  to  show  the  photographer  an  actual  example  (from  a past  pro- 
duction or  magazine  pictures,  etc.)  of  what  Is  needed. 

5.  Audio  Producer  (engineer) . The  audio  producer  is  responsi- 
ble for  producing  audio  tapes,  audio  cassettes  and  studio  recordings. 

The  producer  knows  what  type  of  microphones  are  suitable  for  different 
applications.  The  audio  producer  can  assist  in  all  production  phases 
but  will  bt  most  helpful  in  preparing  the  fina1  integration  of  the 
production  where  th*»  narration,  music,  and  other  audio  sounds  are  com- 
bined. The  audio  producer  will  make  certain  the  audio  production  is 
crisp  and  clear  with  no  unnecessary  background  noises  or  static  and  that 
music  and  voices  are  well  modulated. 


6.  Writer.  Th®  writer  Is  capable  of  either  helping  develop 
the  scripts  and  written  passages  or  taking  the  ideas  and  preparing  a 
script.  8efore  consulting  a writer,  have  a very  good  idea  of  what  is 
needed.  The  writer  needs  guidelines  as  to  what  content  is  needed  in 
the  production.  Provide  a rough  '..•nipt  derailing  specific  content 
needed  in  the  final  production.  Riven  this  inform  tion,  the  writer 
will  be  able  to  develop  a script. 

7.  TV  Producer.  The  television  producer  is  an  expert  in  the 
conceptualization,  development,  production,  and  direction  of  television 
programs.  If  your  plans  call  for  producing  a television  program,  the 
TV  producer  can  give  ulvici-  m how  to  plan  it.  Vou  most  likely  will 
have  to  consult  writers  (if  available),  t seek  the  producer's  help  in 
writing  a script.  The  TV  producer  usually  "visualizes'’  the  completed 
script— that  is,  decides  on  the  camera  shots  and  techniques  to  be  used. 

8.  Technician.  The  (electronic)  technic^n  is  a specialist 
in  the  repair  rnd  maintenance  of  electronic  equipment  such  as  audio 
consoles,  video  switchers,  cameras,  arid  tape  recorders.  The  technician 
repairs  equipment  and  is  familiar  with  the  reliability  of  different 
makes  of  audiovisual  hardware.  Before  purchasing  equipment,  seek  the 
tecnnician's  advice,  It  could  save  needless  expense  later  op.  The 
technician  also  can  familiarize  the  instructional  designer  with  the 
operation  of  production  facility  equipment.  The  technician  also  may 

be  versed  in  the  development  of  new  equipment  and  in  the  reliability 
and  technical  problem  with  different  makes  of  new  "state  of  the  art" 
equipment. 
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2.3  Develop  Instruction 

Following  are  details  of  developing 
various  types  of  Instruction  to  fit.  the  chosen 
instructional  setting,  media  selection,  and 
management  plan.  At  this  point,  o final 
commitment  has  net  been  made  as  1;  details 
of  the  final  product.  The  final  commitment 
should  be  made  only  after  first  drafts  of 
rough  materials  *:ave  been  evaluated  and 
found  to  be  effective.  Details  of  this  evalua- 
tion are  discussed  in  the  next  section. 

2.3.1  Writing  an  Audio-Only  Script 

The  audio-only  script  is  necessary  for  producing  audio  tape  read- 
ings, or  live  radio  productions.  Audio-only  scripts  are  also  prepared 
as  part  of  instructional  programs  where-,  for  example,  learners  may  be 
listening  to  directions  c*  explanations  on  an  audio  tape  while  they  are 
performing  or  being  guided  through  a t^sk. 

When  developing  audio  scripts  remember  the  limitations  of  the  me- 
oium.  The  entire  emphasis  *s  on  the  audio,  since  there  ic  no  accompany- 
ing video.  Use  whatever  techniques  w-'il  stimulate  the  audio  senses: 
music,  sound  effects,  dramatization  , different  voices,  chances  in  pitch, 
cone,  intensity  of  voice,  and  pacing.  However,  do  not  overuse  a tech- 
nique. Use  them  ■ e needed  and  where  they  will  contribute  to  the 
development  of  the  instructional  program.  Take  the  script  to  an  audio 
producer  and  ask  his  advice  on  how  best  to  prepare  and  present  the  ideas 
that  need  to  be  presentcJ. 


i 

l 


i 

i 


} 

i 

* i 

f 

S 

i 


WUMENT 


231 


6 

F- 

f 

i 

5-  , 

t 

I: 


| 

i 

f 


Some  guidelines  for  writing  audi"  only  scripts  are: 

1.  Examine  each  learning  objective  and  learning  step  and 
write  enough  of  an  explanation  to  clarify  each  item. 
Consider  what  the  Intended  audlem.e  already  knows  and 
their  education  level.  Do  not  write  „.ore  than  Is  needed, 
you  can  always  add  more  later  after  the  first  draft 
mateilals  have  been  tested. 

2.  You  now  have  a "bare  bones"  script.  Check  the  script  for 
continuity.  Do  the  Ideas  flow  or  does  the  script  seem 
disjointed?  Read  the  script  aloud  to  yourself  and  hear 
what  it  sounds  like.  If  any  part  of  the  script  sounds 
ur.clear  or  sparse,  add  or  delete  information  where  ne- 
cessary. If  possible,  have  someone  read  the  script  to  you. 

3.  Decide  on  where  changes  in  the  pace  of  the  presentation 
can  best  be  used  to  highlight  the  script  and  maintain 
listener  interest.  Do  not  use  Chinese  gongs  just  for 
effect,  but  if  they  will  add  something  relevant  to  the 
program,  by  all  means  use  them.  The  idea  here  is  to  vary 
the  pacing  and  content  of  the  production  without  resort- 
ing to  gimmickry . If  you  want  to  tell  the  audience  what 
an  air  ,-iid  siren  sounds  like,  do  not  describe  its  fre- 
quency and  pitch.  Instead,  use  a blast  of  a siren, 
father  than  simply  explaining  the  contents  of  a speech, 
use  a dramatization.  Use  appropriate  music  to  bridge  the 
gap  between  different  parts  o,‘  the  program.  When  using 
music,  remember  the  music  should  not  attract  undue  atten- 
tion but  should  complement  the  narration.  The  audience 
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should  not  concentrate  on  the  music  Instead  of  the  Informa- 
tion In  the  program. 

4.  If  pauses  la  certain  parts  of  the  script  arc  necessary. 
Indicate  these  on  the  script.  If  pacing,  cither  faster  or 
slower  than  the  normal  reading  rat ",  Is  needed,  Indicate 
this  on  the  script  also. 

5.  When  writing  the  final  version  of  a script  use  the  format 
shown  in  Figure  III. 13.  The  right  side  of  the  script  con- 
tains all  of  the  spoken  narration  that  will  be  heard.  The 
left  side  of  the  script  is  for  specific  directions  such  as 
adding  music  or  sound  effects. 

After  proceeding  this  far  with  the  audio  script,  you  ere  readv  to 
take  it  to  an  audio  producer  to  have  it  produced. 

2.3.4  Preparing  Vldeo-Cnly  Materials 

There  are  two  purposes  of  a video-only  script.  One  is  to  provide 
guidelines  in  the  development  of  isolated  video  materials  (i.e.,  what 
scene  a photographer  should  take,  what  the  composition  of  a picture 
should  be,  what  information  a chart  or  diagramshould  contain).  The 
first  purpose  then  is  for  the  production  of  individual  materials.  The 
second  purpose  of  a video-only  sc.'ipt  is  for  the  production  of  se- 
quences of  materials.  For  example,  to  produce  a slide  program,  a 
script  outlining  the  sequence  of  pictures  also  is  needed.  (Alternate 
sequencing  orders  are  listed  in  Appendix  A.)  The  video-only  sc.-ipt 
may  be  thought  of  as  a set  of  prescriptions  which  define  the  exact 
criteria  for  the  preparation  of  materials. 


■1 

J 

j 


1 


i 


-"Uuuliumgillliiliiiu  . wiMIMIir n.  aiouiilJiiQniljuaiiiiiW  ffljfllPUiJlUjiiViajJitfflMBi 


Write  the  audio  that  will  be  read 
by  the  narrator  on  this  side  of 
the  script. 


Include  any  special  directions 
on  the  left  side  of  the  script. 
These  could  be  ruusic,  sound 
effects  or  any  other  OLtside 
sources  which  will  be  added  to 
the  final  script. 


rtiso,  write  any  special  directions 
for  the  narrator  on  this  side  of 
the  script.  For  example,  Include 
changes  in  pace,  tone  or  intenrity 
of  voice  and  indicate  them  in 
brackets  [ ].  The  part  of  the 
script  to  be  read  Is  written  in 
capital  letters,  while  cne  direc- 
tions to  the  narrator  are  written 
in  Tower  case  letters. 


FIGURE  III. 13:  Format  for  an  Audio  Script 


When  developing  a vldeo-or.ly  script  remember  that  all  the  Informa- 
tion or  factual  materiil  must  be  Included  In  the  picture  or  visual.  Be 
sure  to  pi'ovid':  the  photographer  c’  graphic  artist  with  enough  Informa- 
tion as  to  the  composition  of  the  visual.  What  details  should  be 
Included?  Is  color  necessary?  What  about  the  size  of  details?  Should 
certain  parts  of  a picture  be  photographed  in  close  detail  or  magnified? 
Should  the  artist  use  arrows,  numbers  or  other  techniques  to  clearly 
delineate  one  part  of  a chart  or  graph  from  another  part?  Is  lettering 
needed  on  the  photographs  or  diagrams,  and  if  so,  what  size? 

Discuss  exactly  what  is  needed  in  each  visual,  whether  It  Is  a photo 
graph  or  drawing,  with  the  photographer  or  artist.  The  following  steps 
will  help  when  producing  visual  materials: 

1.  Examine  each  learning  objective  and  learning  step  to  deter- 
mine what  visual  will  explain  it  best.  Draw  a rough  sketch  which  con- 
tains the  needed  detail  to  explain  the  visual.  An  artist  is  not  re- 
quired here.  All  that  Is  needed  is  sufficient  detail  to  communicate 
with  the  artist  or  photographer.  Rough  sketches  or  stick  figures  or 
the  like  are  known  as  storyboards.  When  a sequence  of  them  is  mounted 
on  a board,  an  outline  of  the  sequence  of  a story  car  be  illustrated. 

The  storyboard  pictures  can  be  siown  to  an  artist,  photographer  or  film 
producer  to  give  him  an  exact  idea  of  the  type  of  visuals  to  produce. 
While  ;he  preparation  of  a storyboard  is  preferred,  an  alternative  is 
to  write  a detailed  description  of  what  content  the  visual  should  con- 
tain. More  than  one  visual  may  he  needed  to  adequately  explain  a 
learning  objective  or  learning  step.  In  any  case,  make  sure  . visu- 
als for  each  learning  objective  or  learning  step  do  adequately  explain 
the  information.  The  important  information  must  be  contained  in  the 
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visual  only  since  no  audio  explanation  will  accompany  It. 

2.  If  special  colors,  highlights,  drawings,  circles,  arrows, 
blowups,  or  lettering  are  neeaed  to  adequately  explain  some  part  of 
the  visual.  Indicate  this  on  the  rough  sketch  or  written  description 
of  the  visual. 

• 2.3.4  The  Audio-Visual  Production 

A large  portion  of  the  mediated  materials  designed  will  probably 
be  some  form  of  audio-visual  production.  Among  the  most  often  used 
audio-visual  productions  are  the  slide  tape,  television  program,  and 
film.  The  production  of  an  audio-visual  program  is  a job  for  skilleu 
media  professionals  so  work  closely  with  production  facilities  per- 
sonnel who  have  expertise  In  the  area.  The  purpose  of  this  section 
is  to  help  desirn  the  audio-visual  scripts  so  they  conmunlcate  what  Is 
needed  to  the  production  personnel.  Figure  III. 14  Is  an  example  of 

] 

the  audio-visual  script  format  and  Figure  III. 15  is  an  example  of  an  < 

J 

audio-visual  script.  I 

Since  audio-visuai  programs  appeal  to  both  the  eye  and  the  ear,  j 

I 

there  are  cotimon  attributes  among  the  different  types  of  productions. 

2,3.4, 1 The  Audio  in  Audio-Visual 

In  discussing  the  preparation  of  audio-only  and  video-only  produc- 

• tions  the  important  point  was  to  derive  the  maximum  benefit  from  a 
me-Jium  which  appealed  to  only  the  sense  of  hearing  or  the  sense  of 
seeing.  In  combining  the  audio  and  visual  media,  there  are  sane  prin- 
ciples to  follow  to  ensure  they  effectively  communicat  to  both  senses. 
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VIDEO 

All  the  visual  sequences  of  the 
program  are  written  on  this 
side  of  the  script. 


Storyboard  pictures  can  be 
Illustrated  on  this  side  of 
the  script  to  correspond  with 
the  narration. 


All  narration  and  specific 
directions  for  the  narrator 
are  listed  on  this  side  of 
the  script.  In  an  audio- 
visual script  all  special 
directions  that  have  anything 
to  do  with  audio  such  as  music 
are  written  on  the  right-hand 
side. 


FIGURE  III. 14:  Format  for  an  Audio-Visual  Script 
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Draft  * 


AiiniO* VlftJAL  SCRIPT 


LESSON  « 201-113-4692-P 


Radio  Teletypewriter 
TITLE  Communication  Proceiluro 


42.  Print  C'jpy i 

(5SF)  (2CR)  (LF) 
A2U  DE  KR3T 


6F26 

NET  CALL 
A2L7 


43,  Print  Copy: 

"CO  AHEAD- 
MACHINE  FUNCTIONS 


44.  Repent  Frame  12  only 
add  i 

K ( 2CR)  (LF) 

(after  KRT3) 


16.  Repeat  Frame  31, 
Arrows  pointing  to 
C3X6  and  JP4L 


42.  Yo-ir  paper  shoul  look  like  this. 


(STOP) 


13.  Complete  the  call  by  listing  t»e  prosign 
meaning  "Co  Ahead"  and  the  end  of  line 
machine  functions.  (STOP) 


44.  Dees  your  call  look  like  this? 


(STOP) 


45.  Let’s  try  another  one.  Select  t..e  net 
call  sign  and  the  call  sign  of  the  NCS . 

Then  construct  the  preliminary  call  which 
the  NCS  would  use  to  contact  all  the  sub- 
stations in  his  net  'oy  u ng  a single  call. 

(STOP) 


FIGURE  III. 15:  Sample  Audio-Visual  Script 
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Narration  (audio)  should  be  used  to  explain  details, 
suggest  relationships,  or  supply  any  Kind  of  Informa- 
tion that  cannot  bo  adequately  explained  in  the 
visuals. 

The  narration  should  always  be  related  to  the  visual 
being  seen.  The  narration  should  not  compete  with  the 
visual  by  describing  or  calling  attention  to  details  not 
in  the  visual . If  in  doubt,  ask  . self  "does  the 
narration  complement  the  visual?"  If  the  arisvrr  is  io 
then  rewrite  the  narration  until  it  does. 

Use  the  narration  to  identify  nr  describe  the  content  of 
a visual  as  soon  rs  the  visual  appears.  Do  not  make 
the  audience  guess  what  the  content  of  a visual  is  all 
about.  Tell  them. 

Narration  should  always  be  simply  written.  Do  not  use 
long,  comnlicated  sentence  structures  with  multiple 
clauses.  Use  a simple  vocabulary.  Try  and  strike  a 
balance  between  brevity  and  simplicity  without  talking 
down  to  the  audience. 

Vary  the  pace  of  the  narration:  Allow  for  breaks  of 

silence  to  bridge  different  visuals  or  use  short  musi- 
cal bridges  that  serve  to  vary  the  p?ce  of  the  program. 
But  remember  the  music  should  complement  the  overall 
pace  of  the  program.  Do  not  use  lord  or  boisterous 
music  that  will  distract  from  the  visual  portion  of 
the  program, 


In  designing  the  visual  component  of  a production.  It  Is  inpjrtant 
to  visualize  what  It  Is  you  are  trying  to  describe.  The  emphasis  In 
the  production  of  an  audio-visual  production  is  often  on  the  visual ?. 
that  is,  the  audio  Is  used  to  describe  the  visual.  However,  the  impor 
tant  point  that  the  visual  and  audio  work  together  to  present  the 
desired  information. 

2. 3. 3. 3 Producing  a Slide-Tape  Program 

The  slide-tape  Is  one  of  the  most  widely  used  of  all  audio-visual 
productions  because  .t  Is  relatively  inexpensive  to  make,  elaborate 
equipment  is  not  required,  end  it  is  ..ot  difficult  to  reproduce. 

The  slide- tape  is  simply  a combination  of  slides  accompanied  by  a 
tape  recorded  narration  explaining  and  describing  the  slides.  A syn- 
chronizing pulse  is  placed  on  the  audio  tape  to  synchronize  the  audio 
and  the  visual,  The  pul  e is  recorded  on  the  taps  by  the  audio  pro- 
ducer or  technician.  It  car,  be  either  audible  for  manually  advancing 
the  slides  or  inaudible  and  automatic. 

1,  Wo  single  visual  (i.e.,  slide)  should  be  or  the  screen 
too  long.  After  rporoximately  20  seconds  the  audience 
tends  to  become  hored  and  restless  and  easily  distracted 
from  the  program,  ben-ember  this  when  planning  the  story- 
board and  avoid  writing  A0  seconds  of  narration  for  a 


visual  that  should  not  be  on  th  ■ screen  longer  than  20 
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seconds.  If  a longer  time  period  is  needed  to  explain 
a visual,  a second  similar  visual  can  be  planned  to  fellow 
the  first  on  The  second  visual  ran  be  taken  from 
another  angle  or  be  a different  size  than  the  first  one. 

In  any  case*  It  should  be  different  in  some  way  but  still 
be  logically  related  to  the  first  one.  Also,  try  to  vary 
the  pacing  of  the  program  h-'  hfving  slides  on  the  screen 
for  different  periods  of  time.  When  designing  a program, 
do  not  think  of  technique  first  but  do  remain  aware  of  the 
fact  that  the  program  should  be  lively  and  interesting. 

To  plan  the  production  of  a slide-tape  program,  prepare 
storyboards  for  each  item  of  information.  A storyboerd  is 
simply  or, X or  many  cards  or  papers  (see  Figure  HI. 16) 
whicn  contain  a rough  sketch  of  the  picture  or  visual  to 
be  photographed  or  drawn.  In  addition  to  the  sketch, 
which  snould  be  placed  at  the  top,  write  on  the  bottom 
of  the  storyboav-d  the  narration  which  will  accompany  the 
slide,  if  music  is  to  accompany  the  slide  indicate  this 
also.  The  storybjard  also  should  contain  a number  indi- 
cating what  Learning  Objective  Analysis  Worksheet  each 
storyboard  relates  to. 

Check  the  sequence  of  the  storyboarus.  Visualize  the 
sketches  or  each.  Does  each  picture  and  accompanying 
narration  follow  a loqical  sequence?  Are  there  any  am- 
biguities or  gaps  where  information  is  missing'’  If  so, 
add  more  pictures  or  narration.  Run  througn  the  sequence 


the  audio  producer  who  will  arrange  to  have  a narrator 
read  the  scr.pt. 

6.  The  final  production  step  is  to  indicate  on  the  audio 
script  whore  tie  slides  should  change;  that  is,  how  the 
slide'  should  be  synchronized  with  the  audio.  A small 
x,  or  any  othar  mark  at  the  appropriate  points  on  the 
audio  script  will  provide  tne  eudi-  producer  with  the 
required  information  for  -ynchronizing  the  audio  and 
visual  exponents  of  the  program.  This  should  complete 
the  production  of  the  slide-tape  program 

2. 3. 3. 4 Film  Production 

Due  to  the  complexity  and  high  cost  and  time  commitments  involved 
in  film  production,  there  are  very  few  valid  reasons  to  undertake 
the  production  of  a film.  This  Is  especially  so  considering  the  tech- 
nology and  state  of  the  art  of  video-tape  recording  and  editing  which 
make  the  production  cf  high  quality  television  programs  a most  suitaoie 
alternative  to  film  production. 

2. 3. 3.5  Producing  a Tel evisi on  Program 

The  production  of  a television  program  is  the  job  of  a television 
producer  or  director.  Skilled  professionals  are  needed  to  handle  the 
numerous  details  and  technical  procedures  necessary  to  produce  a com- 
pleted television  program.  Since  television  involves  movement,  audio, 
and  video,  the  television  progra.  : should  reflect  the  valid  use  of  each 
of  those  elements. 


The  production  of  a television  program  involves  a rather  compli- 
cated set  oi'  procedures  and  techniques.  Since  conceptualizing  how  a 
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television  picture  will  look  on  the  screen  requires  considerable  exper- 


tise do  not  be  concerned  with  describing  camera  shots,  camera  move- 
ments, lenses,  scene  transitions,  or  "blocking"  in  the  script,  This  is 
the  job  of  the  television  producer  or  director.  A television  producer 

* develops  a visual  sense  after  many  years  of  practice  and  experience  so 
it  would  be  unrealistic  to  expect  to  do  the  same  <n  a short  period  of 

* time  Tour  primary  function  in  designing  a media  production  is  to 
conmunicate  the  specific  requirements  to  the  media  professionals.  This 
is  accomplished  by  presenting  tne  television  producer  with  a completed 
storyboard  so  that  he  can  visualize  the  progr-in 

The  process  of  developing  a storyboard  was  explained  in  the  section 
on  sl’'de- tape  prod>  :tion,  so  it  is  not  necessary  to  elaborate  further. 
However,  ther'  are  some  differences  between  a slide  storyboard  and  a 
storyboard  suitable  for  a television  prodi'ction  which  are  worth  noting: 

1.  Television  is  not  static;  it  involves  movement.  Remember 
this  when  waiting  the  storyboard  and  do  not.  plan  for  only 
static  or  still  pictures. 

2.  When  preparing  a storyboard,  desc.ibe  in  detail  the  compo- 
sition of  the  required  picture.  Do  not  worry  about  tech- 
nique, how  it  will  be  executed,  or  about  using  the  right 
jargon.  Leave  that  to  the  producer.  If  a close-up  of  a 
picture  is  needed  to  show  detail,  or  if  a large  object 

* 

needs  to  be  viewed  from  far  out.  simply  indicate  this  on 
the  storyboard.  The  producer  will  decide  the  techni-.al 

» 

details 
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3.  Generally  the  visual  will  carry  the  important  part  o* 
the  message  and  the  audio  will  be  used  to  accompany  and 
explain  the  video. 

4.  In  piann'  3 each  storyboard  try  to  imagine  how  best  to 
visualize  the  message  that  needs  to  be  presented.  Decide 
what  would  be  the  best  picture  or  sequence  cf  pictures  to 
explain  this  information.  Again,  do  not  worry  about  the 
technique  of  how  M i ^rograjn  will  be  produced.  Simply 
communicate  on  the  storyboard  what  is  required.  The  pro- 
ducer will  take  it  from  there. 

5.  When  the  set  of  at  ryboards  is  completed,  check  the  se- 
quence as  c 'plained  before.  The  storyboards  should  now 
be  taken  to  the  producer. 

2.3.4  Developing  Printed  Materials 

Printed  materials  include  printed  words,  art  work,  photographs,  or 
some  comainatlon  of  these.  The  same  Guidelines  given  for  audio-visual 
productions  apply  to  developing  printed  art  work  and  still  photography. 

Even  though  print  is  a relatively  inexpensive  medium,  there  are. 
costs  associated  with  each  additional  piece  of  information,  both  in 
terms  of  reproduction  and  student  time  to  read  it.  Write  all  the 
student  needs  to  know  about  each  learning  objective,  but  do  not  write 
one  word  more. 

2.3.3  Developing  Programmed  Instruction 

One  good  example  of  a systems  approach  to  designing  instruction  is 
programmed  instruction.  Programmed  instruction  V^I)  is  characterized 
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by  presenting  the  student  with  information  to  which  he  has  to  make  some 
kind  of  response  before  In.  can  proceed  further  in  the  instruction. 

After  each  response  the  student  is  informed  of  his  progress  and  he  then 
proceeds  in  a similar  manner  through  the  entire  program  of  instruction. 

Following  are  some  of  the  characteristics  of  programned  instruction: 

?.  All  forms  cf  PI  are  designed  to  involve  the  student  actively 
in  the  process  of  learning.  Instruction  in  a program  is 
divided  up  into  units  called  frames.  A frame  usually  con- 
tains a small  amount  of  information  and  a question  for  the 
student  to  answer  based  on  the  information  in  that  frame. 

The  question  provides  an  opportunity  tor  the  student  to 
actively  respond.  The  student  answers  the  ques'  ion  before 
proceeding  to  the  next  frame. 

2.  The  next  frame  of  Instruction  generally  contains  the  correct 
answer  to  the  question,  ''he  process  of  supplying  immediate 
knowledge  of  results  is  known  as  feedback. 

?.  PI  materials  al low  the  student  to  proceed  at  his  own  speed 
r rate  of  learning.  Students  d^  nov.  have  to  kerp  pace 
with  other  students  in  the  class  who  way  be  receiving  tho 
same  instruction. 

The  design  of  good  effective  PI  is  a complex  procedure  of  activities 
which  should  be  performed  by  skilled  professionals.  If  you  would  like 
to  attempt  to  desigr.  PI,  refer  to  one  of  the  excellent  references  listed 
at  the  end  of  this  phase. 
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2.3,6  Developing  Platform  Lectures 

Since  the  primary  advantages  of  the  platform  lecture  approach  are 
the  flexibility  of  content  and  the  ease  of  providing  a wide  range  of 
immediate  feedback  to  students,  the  inputs  to  the  lecturer  should  be 
outlines  and  aids  rather  than  a rigid  format.  Following  are  some 
guidelines  for  materials  that  should  be  developed  and  presented  to  the 


lecturer. 


1.  The  lecturer  should  be  provided  with  the  learning  objec- 
tives to  be  covered  and  the  test  items  that  the  students 
will  be  expected  to  complete  as  a result  of  what  they 
learn  from  the  lecture. 

2.  While  the  lecturer  probably  is  a subject  matter  expert 
in  his  field,  he  should  be  provided  with  sources  for  all 
the  information  essential  to  the  lecture. 

3.  Any  audio-visual  aids,  demonstration  objects,  examples, 
suggested  answers  to  students*  questions,  or  other  aids 
that  can  help  in  the  delivery  of  an  effective  lecture 
should  be  provided. 


2.3.7  Developing  Self-Teaching  Expo* table  Packages  (STEPs) 


STEPs  may  use  a single  medium  or  a combination  of  media.  For 
example,  audio-visuals,  programmed  instruction,  and  audio-only  might 
be  used  in  the  same  lesson  or  series  of  lessons.  In  general,  the 
guidelines  already  given  for  developing  instruction  for  the  specific 
media  are  also  applicable  to  STEPs.  However,  one  additional  pre- 
caution should  be  taken.  Since  the  user  of  a SttP  may  not  be  able  to 
aet  immediate  or  detailed  assistance  if  he  need*;  it.  onater  effort 


Supplementary  instruction  is  any  instructional  material  (Him, 


textbook,  television  program)  which  has  been  validated  as  providing 
effective  supplementary  instruction. 


EXAMPLES 


1.  An  excellent  instructional  program  might  already  exist 
for  performing  maintenance  on  a particular  piece  of 
equipment.  Hcwever,  several  minor  modifications  to 
the  equipment  nay  make  additional  instruction  neces- 
sary. Rather  than  revise  the  existing  information, 
a more  economical  approach  may  be  to  develop  an 
adjurct  program  to  provide  the  additional  informal  ion. 


J 


2.  When  developing  a new  Instructional  program, 
several  Items  of  existing  Instructional  material 
may  have  been  located  that  cover  90  percent  of 
the  learning  objectives.  An  adjunct  program  may 
be  developed  for  the  remaining  10  percent  of 
the  objectives. 

3.  A small  group  of  closely  related  tasks  may  be 
performed  by  only  a small  percentage  of  a DOS. 

An  adjunct  program  might  be  developed  to  supple- 
ment the  existing  program,  and  to  be  used  only 
by  those  who  need  to  perform  the  extra  tasks. 


Any  o.  the  media  approaches  discussed  earlier  may  be  used  for 
supplementary  instruction.  Following  are  several  guidelines  for 
developing  such  programs: 

1.  Be  sure  the  learning  objectives  to  be  covered  by  the 
supplementary  Instruction  are  carefully  selected. 

These  should  be  learning  objectives  that  are  inade- 
quately covered  or  not  covered  at  all  by  the  existing 

instruction.  | 

4 

2.  While  redundant  instruction  should  be  avoided,  some  re- 
dundancy may  be  essential  to  provide  continuity  in  the 
supplementary  program. 

3.  Be  sufficiently  familiar  with  the  instruction  to  oe 
supplemented,  to  use  a style  and  media  approach  with 
the  adjunct  program  that  complements  the  basic  instruc 
tional  program. 

4.  It  is  not  essential  to  present  all  the  supplementary 
materials  at  one  time.  Portions  may  be  inserted  into 
the  «.otal  program  whenever  they  are  needed. 
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2.3.9  Developing  Adjunct  Programs 

An  adjunct  program  uses  special  directions  plus  existing  Instruc- 
tional material  (film,  textbook,  slide  tape).  It  Is  developed  by  using 
the  learning  objectives,  test  items,  and  directions  to  guide  the  stu- 
dent to  specific  parts  of  the  existing  instruction.  The  adjunct  in- 
struction must  then  go  through  the  same  validating  process  describing 
in  Block  Hi. 5.  Sometimes  students  self-program  instruction  when  given 
the  objectives  and  resources. 

Adjunct  programming  can  be  both  effective  and  Inexpensive  while 
time  for  development  is  minimized. 


f 

l 


* 

i 
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EXAMPLE 


Learning  objective: 

Using  TM  38-750  and  situations,  determine 
whether  a OA  Form  2408-13  should  be  used. 

Read  TM  38-750  section  4-12,  paragraphs  a,  b, 
c(l),  and  c(2)  and  answer  the  following 
questions: 


r \ 

Learning  objective: 

Using  TM  38-750,  fill  in  Block  17  (Faults  1 

and/or  remarks). 

Read  TM  38-750  section  4-12,  paragraph  (3) 
and  fill  in  your  DA  Form  2408-13  for  the 
following  situation: 


•j..,  m ib.iii. ,..1L  j .. jm  -iiuiiuii dll li'Xllfll'l lUuiiiliJilk.  .■  ....  miiiiii-jp  ^UaiJUlHiiiiJlSliillllllDCdlllillls^rf!  nlfraiteu'  J .-llill 


2.3.1h  Job  Performance  Mds  (JPAs) 

A JPA  is  a type  of  performance  device,  usually  In  the  form  of  a 
written  ptoceduro  vjith  illustrations,  charts,  checklists,  or  tables  of 
data.  These  materials  are  designed  to  provide  information  that  does 
rot  have  to  be  learned  In  the  classroom  or  otherwise  committed  to 
memory.  A JPA  is  used  on  the  job  as  an  aid  or  assistance  in  the  per- 
formance of  a task.  JPAs  are  usually  prepared  for: 

1.  Behavior  sequences  that  are  long  and  complex 

2.  Tasks  that  are  rarely  performed 

3.  Tasks  that  involve  readings  snd  tolerances 

4.  Tasks  that  are  aided  by  the  presence  of  illustrations 

5.  Tasks  tnat  utilize  reference  information,  such  as  ..ibles, 
graphs,  flowcharts,  and  schematics 

As  in  the  production  of  other  forms  of  media,  consult  and  use  the 
services  of  installation  experts  In  the  production  of  JPAs,  as  well  as 
the  media  experts  who  will  produce  the  first  draft  materials.  The 
to1 lowing  series  of  steps  should  be  useful  in  the  preparation  of  JPAs. 

1.  Verification  of  Activity  Steps.  Each  step  should  contain 
only  one  simple  operation  or  movement.  Do  not  have  too  many  compound 
procedures  such  as  adjust...,  then  rotate...,  then  align...,  then  cali- 
brate.... It  would  be  better  to  list  each  of  these  steps  individually. 
Each  step  should  be  the  smallest  component  of  the  task.  Experts  often 
hove  shortcuts  or  other  time  and  work  saving  techniques  they  use  while 
performing  a task.  Often,  after  many  years  on  a job  they  are  not  even 
aware  of  this.  Howe\er,  for  the  purpose  of  designing  JPAs,  identify 
every  step,  procedure,  or  operation  necessary  for  a novice  to  perform 
the  task.  Work  through  the  task  following  the  list  of  steps.  Proceed 


263 


from  one  step  to  the  next.  If  "gaps"  are  apparent  between  steps  or 
parts  of  a task  cannot  be  performed  because  previous  steps  are  not  on 
the  list  (l.e.,  these  may  be  expert's  shortcuts)  then  adjust  the  list 
to  Include  these  steps. 

2.  Grouping  of  Steps  Into  Units.  One  widely  used  type  of  JPA 
consists  of  written  text  and/or  written  text  and  illustrations.  In 
performing  most  technical  tasks  where  a technician  has  to  manipulate, 
adjust  or  align  equipment,  the  inclusion  of  pictures  in  a JPA  is  almost 
mandatory.  As  a general  guideline,  steps  should  be  grouped  into  appro- 
priate units.  Each  unit  should  consist  of  the  appropriate  number  of 
steps  necessary  to  complete  that  portion  of  the  task.  For  example,  if 
six  separate  steps  arc  needed  tc  align  a tuner,  these  could  be  listed 
as  one  activity  comprising  the  six  individual  steps.  Or  if  nine  cali- 
brations are  r.eeaed  to  align  a piece  of  equipment,  these  could  be 
grouped  together.  (See  Figures  HI. 18  and  III. 19  for  examples.) 

Production  rf  OPAs.  After  steps  are  grouped  together  it 
is  time  to  think  of  how  the  activities  will  be  illustrated.  Take  the 
JPA  work  to  a graphic  artist  who  is  skilled  in  the  production  of 
visuals  for  such  purposes.  Most  installations  usually  have  trained 
personnel  who  are  capable  of  designing  visual  illustrations  for  JPAs. 

The  most  common  an  useful  type  of  illustration  is  the  "blowup"  chart 
or  diagram  which  is  often  referred  tc  as  an  "exploded"  diagram.  Those 
diagrams  are  simply  expanded  views  of  parts  of  sections  of  equipment 
that  visually  illustrate  the  list  of  steps  comprising  each  activity. 

(See  Figure  III. 20  for  an  example.)  The  diagrams  are  usually  sho^n 
from  several  different  views:  front,  right  and/or  left  side,  back. 

Different  views  are  shown  only  if  they  are  relevant  to  the  performance 
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2. 


3. 


4. 

5. 

6. 

7. 


8. 


SPC 

9. 

10. 


11. 


Set  HOT  and  COLD  Mixing  Valve  controls  to  OFF. 

Connect  Pressure  Gauge  to  discharge. 

Set  COLD  control  to  ON.  Check  that  Pressure  Gauge  indicates 
between  59.9  and  60.1  PS  I . If  not,  go  t.  step  9. 

Set  COLD  control  to  OFF.  Disconnect  guage , allow  pressure 
to  bleed  off.  Reconnect  Pressure  Gauge. 

Set  HOT  control  to  ON.  Qteck  that  Pressure  Gauge  Indicates 
between  59.9  and  60.1  PSI.  If  not,  go  to  step  21  (Action 
Tree  for  Symptom  01). 

Set  HOT  control  to  OFF.  Disconnect  Pressure  Gauge. 

Set  HOT  control  to  ON.  Place  bulb  end  of  thermometer  in  hot 
wnte,‘  discharge.  Check  that  thermometer  indicates  between 
130  and  140°  F.  if.  not,  replace  WH-1  and  go  to  step  1. 

Set  HOT  control  to  OFF. 

CHECKOUT  ENOS  HERE 

Set  COLD  control  to  OFF.  Disconnect  gauge,  allow  pressure 
to  blued  off.  Reconnect  Pressure  Gauge. 

Set  HOT  control  to  ON.  Check  that  Pressure  Gauge  indicates 
between  59.9  and  60.1  PSI.  If  not,  go  to  (Action  Tree  ror 
Symptom  04). 

(This  will  be  the  first  step  in  the  Action  Tree  for  Symptom  02.) 


FIGURE  III. 18.  Checkout  Procedure  for  Illustrative  Purposes 
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FIGURE  III. 19.  Failure  Mode  Analysis  for  Illustrative  Purposes 


FIGUPc  in. 20.  Maintenance  Fr«.ne  with  Illustrations  Proper  Size  ’•nd  Image  Area  Well  Utilized 
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of  the  activity.  Consult  the  reference  Manuel  listed  at  the  end  of 
this  phase  for  examples  of  illustrating  JPAs. 

4.  Check  Draft  JPA.  Once  a draft  of  the  JPA  Is  comp1' ate,  ask 
someone  else  to  work  through  It.  This  check  will  rer /e  as  * rough 
guide  to  determine  if  all  the  steps  needed  to  perform  the  Individual 
activities  have  been  'isted.  If  another  person  cannot  meet  the  JPA  ob 
jective,  perhaps  additional  steps  are  , leaded,  or  additional  illuscrative 
visual  aids  are  required. 

2.3.11  developing  Formal  On-The-Job  Training  (FPJT) 

In  FOOT,  both  the  trainee  and  the  ins true to-  operate  in  the  actual 
, so  environment.  FOJ1  is  usually  carried  out  in  the  following  way: 

1.  The  tasks  are  explained  to  the  trainee  J.y  the  Instructor. 

An  ''explanation,"  in  this  context,,  is  usually  both  a 
verbal  explanation  and  a demonstration  of  how  the  job  is 
performed . 

2.  The  trainee  observes  the  instructor  s dimonstration  and 
explanations. 

3.  The  trainee  may  required  to  describe  the  important 
features  o*  the  task  as  he  observed  them. 

4.  The  trainee  carries  out  all  or  part  of  the  job  task 
(depending  on  the  amount  of  time  needed  to  :omplete  the 
entire  task  and  the  complexity  of  the  task)  under  the 
instructor's  guidance. 

5.  The  trainee  continues  to  perform  the  task,  unoer  an  instruc- 


t 

\ 


I 


! 


I 

\ 


! 

1 


i 

i 


m 


tor's  supervision,  until  he  is  proficient  enough  to  per- 
form the  assigned  tasks  alone. 
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FOOT  may  be  carried  out  either  on  the  actual  job  site,  under  the 
actual  production  conditions,  or,  in  a separate  production  area  which 
is  removed  from  the  actua1  production  line  or  process.  However,  in 
most  cases,  FOOT  occurs  on  line  utilizing  ordinary  production  equip- 
ment and  conducted  by  the  shop  supervisor. 

The  development  of  FOJT  requires  more  than  just  running  the  student 
through  hejob.  FOOT  normally  requires: 

1.  Instruction  which  is  pre-planned  following  a systematic 
approach  to  designing  instruction  for  a specific  objective 

2.  Reasonable  time  limits  to  complete  the  training  sequence 

3.  A schedule  of  specific  job  related  performances  which  must 
be  completed  and  approve-  before  the  trainee  is  considered 
trained 

4.  The  administration  of  JPMs  to  determine  if  the  trainee  can 
perform  the  job  to  standards 

5.  Directions  for  the  supervisor 

In  FOJT  the  student  often  must  learn  tasks  "off  line."  It  Is  often 
necessary  to  oevelop  accompanying  reading  materials,  manuals,  or  Job 
Performance  Aids  (OPAs).  The  student  will  s.vnetimes  spend  time  outside 
of  the  classroom  reading  and  preparing  for  the  FOJT  whe^e  he  will  re- 
ceive practical  experience  in  the  performance  of  a task.  For  example, 
the  student  may  have  to  familiarize  himself  with  -harts,  diagrams, 

JPAs,  and  manuals  pertaining  to  the  ooeration  of  equipment  or  systems 
before  lie  begins  FOJT.  Then,  while  he  is  actually  engaged  in  FOJT 
ha  may  continue  to  consult  these  other  sources  as  he  progresses  through 
the  FOJT  program. 


FOJT  is  normally  part  of  a progression  through  skill  levels  In 
various  DOS.  That  is,  without  FOJT,  the. e can  be  no  promotion  beyond 
a certain  level.  The  FOJT  is  progressive;  as  the  trainee  develops 
more  'kill  on  a spt.  fic  job  and  advances  to  a new  job,  he  will  under- 
take a new  FOJT  program. 

When  designing  FOOT,  it  is  important  to  realize  that  a task  is  not 
always  taught  or  learned  In  the  same  order  in  which  it  is  carried  out 
under  actual  job  conditions.  Sometimes  it  is  easier  for  a trainee  to 
learn  one  task  or  skill  before  he  learns  another,  even  though  the 
sequence  used  in  learning  the  tasks  is  different  from  the  sequence  in 
which  the  tasks  are  performed  on  the  jcb. 

FOJT  need  not  consist  solely  of  the  actual  on-site  job  t lining, 
stimulus  materials  such  as  charts,  diagrams,  slides,  films  or  tele- 
vision programs  displaying  the  job  functions  can  all  be  used  to  advan- 
tage in  FOJT. 

The  best  method  in  designing  an  FOJT  program  is  to  use  a thorough 
task  analysis  of  the  job  with  the  assistance  of  a subject  matter  ex- 
pert or  a skilled  professional  on  that  job. 

2.3.12  Other  forms  of  Mediated  Instruction 

The  preparation  of  first  draft  materials  discussed  in  this  block 
represent  the  most  often  used  media  forms  and  instructional  settings. 
There  are,  of  course,  other  forms  of  instruction  such  as  computer 
assisted  instruction.  The  preparation  of  learning  materials  in  th.'s 
form  requires  very  specialized  skills  and  it  is  unlikely  that  you  will 
design  such  materials. 


But,  regardless  of  the  final  media  form  In  which  the  Instruction  Is 
to  be  devellvered,  always  follow  the  pre-production  steps  outlined  In  this 
block.  By  doing  so,  you  will  aave  a clear  and  detailed  outline  of  a 
learning  objective  which  can  bt  put  into  final  media  fora  by  the  appro- 
priate personnel. 

After  the  first  draft  materials  have  been  prepared  the  next  step 
Is  to  evaluate  their  effectiveness  In  accomplishing  the  learning  objec- 
tives). The  Information  gathered  In  evaluating  the  instruction  will 
be  used  to  redesign  it  and  produce  the  instruction  In  final  foym. 

2.4  Pre-Test  First  Draft  Materials 

The  purpose  of  designing  first  draft  materials  is 
to  ensure  that  large  amounts  of  time  and  money  are 
not  spent  in  the  development  of  ineffective  instruc- 
tional materials.  It  is  important  to  pre-test  small 
amounts  of  instruction  before  large,  sections  of 
first  draft  materials  are  tested,  to  determine  their 
effectiveness. 

One  method  of  pre-testing  first  draft  materials  is  to  take  a small 
meaningful  unit  of  instruction  of  about  5-10  minutes  duration  and  try  it 
out  cn  one  student  or  trainee.  The  purpose  of  this  pre-test  is  to  locate 
ambiguous  directions,  inconsistencies,  redundancies,  etc.  Try  to  locate 
errors  at  this  point  before  larger  units  of  first  draft  materials  are 
des i gned , 

If  the  student  who  cries  out  the  instruction  achieves  correct  re- 
sponses to  all  questions  and  otherwise  experiences  no  difficulties, 
the  instruction  may  not  be  lean  enough.  That  is,  perhaps  too  much  in- 
struction has  been  put  into  the  materials.  In  designing  instruction 
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It  Is  advantageous  to  develop  “lean"  instruction  or  just  enough 


Instruction  to  teach  an  objective.  Then,  if  the  instruction  proves 


to  be  Ineffective  in  some  area,  more  information  can  oe  added.  Design- 


ing instruction  in  such  a fashion  ensures  the  efficient  use  of  re- 


sources and  most  Important,  Instruction  that  is  effective  in  reaching 


the  goals  it  was  designed  to  achieve. 


If  the  student  who  tries  out  the  instruction  experiences  diffi- 


culties, It  may  be  profitable  to  again  test  out  the  instruction,  after 


revisions,  on  another  student.  Beyond  practical  considerations  of  time 


there  is  really  no  limit  to  the  amount  of  pre-test  tryouts  that  can  be 


conducted  until  the  instruction  is  successful.  The  techniques  for 


testing/validating  instruction  are  presented  in  Block  III. 5. 


Design  about  30  minutes  of  instruction  or  a small  meaningful  unit 


and  then  try  it  out.  This  Instruction  is  what  is  referred  to  as  ‘‘first 


draft."  It  consists  of  all  the  factual  information  cards  (storyboard) 


that  have  been  developed. 


As  a general  rule,  do  not  develop  more  than  30  minutes  of  instruc- 


tion before  you  test  it  out  to  determine  its  effectiveness.  What  you 


should  do  is  develop  a meaningful  ;<nit  of  instruction.  Obviously,  what 


is  needed  is  a unit  or  olock  of  instruction  that  is  designed  to  teach 


some  portion  of  the  objective.  Remember  that  the  30  minute  limit  is  a 


guideline  and  not  to  be  Interpreted  as  the  absolute  limit.  Do  not 


stop  developing  instructional  materials  when  you  reach  30  minutes,  and 


then  try  and  test  something  that  is  an  incomplete  unit  and  does  not 


make  sense  to  the  student.  If  you  develop  a meaningful  unit  of  instruc- 


tion that  takes  15,  20,  or  25  minutes  to  teach,  this  too  is  fine.  The 


main  idea  is  not  to  get  carried  away  developing  sizeable  portions  of 


instruction  without  testing  them  out.  This  is  simply  an  inefficient 


use  of  tin®  and  money. 

After  a small  unit  of  instruction  has  been  tried  out  and  revised 
and  first  draft  materials  have  been  tried  out  and  revised,  the  final 
revised  storyboard  Information  cards  are  ready  to  be  produced  In  their 
appropr.ate  media  form  and  validated  according  to  the  procedures  out- 
lined in  Block  III. 5. 


2.5  Prepjre  User  Instructions  1 


After  all  instructional  materials  have 

i 

been  prepared  and  are  ready  for  testing,  I ^ I 

write  user  instructions.  The  purpose  of  L— 1 

user  Instructions  is  to  ensure  that  the  [_ZZ_J 

i . i 

course  materials  and  management  plan  are 
used  as  they  were  designed  to  bo  used. 

User  instructions,  both  teacher  and  stu- 
dent, must  also  be  validated.  Therefore 
the  Instructions  you  prepare  are  not  yet 

considered  to  be  In  their  final  form.  They  will  be  tested  and  revised 
along  with  the  Instructional  materials  according  to  the  methods  and 
procedures  discussed  in  Block  III. 5. 


2.5.1  Prepare  instructor's  Guide 


The  Instructor's  Guide  Is  a series  of  lesson  guides  that  collec- 
tively outline  the  testing,  teaching,  and  learning  activities  to  be 
accomplished  in  a course  of  instruction.  By  carefully  specifying  the 
activities  expected,  the  instructional  designer  should  create  a plan 
to  coordinate  both  instructor  and  student  activities  with  the  outline 
of  instruction  in  each  lesson  guide.  Proper  development  of  the 


262 

Instructor's  Guide  Is  Important  since  the  document  will  serve  as  the 
instructor's  primary  teaching  aid. 

All  information  that  relates  to  the  activities  required  for  ."stu- 
dent achievement  at  a particular  level  of  instruction  should  be  out- 
lined In  the  Instructor's  Guide.  This  may  include  such  activities 
as  utilization  of  training  devices.  Instructional  materials,  training 
aids  and  equipment,  teaching  tecli,;1ques  and  methods,  and  demonstration 
exercises  ar.d  applications  that  will  collectively  enhance  the  learning 
process.  Additionally,  basic  facts  about  the  rourse  should  be  in- 
cluded. The  following  major  categories  of  information  can  serve  as  a 
guide  to  the  types  of  information  that  should  be  included : 

1.  Instruction  description 

2.  Target  population  description 

3.  Testing  Information 

4.  System  performance  data 

5.  Administration  directions 

2. 5. 1.1  Instruction  Description 

The  instruction  description  '••hould  include  three  major  areas  of 
information: 

1.  The  rationale  for  the  Instruction, 

2.  An  overview  of  what  will  be  accomplished,  and 

3.  A plan  of  instruction. 

The  rationale  includes  a statement  of  the  purpose  and  scope  of  the 
instruction.  It  covers  basic  information  such  as  what  job  the  student 
will  be  prepared  for,  for  whom  the  instruction  is  intended,  and  how  far 
the  instruction  will  take  the  student.  An  overview  of  the  instruction 


should  be  Included  to  give  a broad  picture  of  the  entire  program.  The 
contents  of  each  lesson  or  Instructional  block  should  be  briefly  re- 
viewed in  the  proper  sequence.  A plan  of  Instruction  or  a syllabus  for 
each  Cessna  should  be  Included.  It  should  contain  the  following  informa- 


1.  Learning  objectives  for  each  block  or  lesson 

2.  Duration  of  the  training  for  each  learning  stage 

3.  Instructor  requirements  and  duties 

4.  Media,  resources,  training  aids,  and/or  facilities  required 
2. 5. 1.2  Target  Population  Description 


The  target  population  refers  to  the  characteristics  of  the  intended 
student  users  of  the  Instructional  materials.  This  information  should 
have  been  previously  defined  as  part  of  the  ISD  process.  From  the 
analysis,  the  following  information  about  the  target  population  should 
be  extracted  for  inclusion  in  the  Instructor's  Guide: 

1.  Academic  or  educational  level 

2.  Previous  training  or  related  knowledge  and  experience 

3.  Required  physical  and  personal  characteristics 

4.  Administrative  restraints  (i.e.,  required  rank  or  grade) 

2. 5. 1.3  Testing  Information 

The  third  important  section  of  information  to  be  included  in  the 
Instructor's  Guide  is  the  testing  information.  This  includes  tests  for 
each  module,  unit,  and  lesson,  all  of  which  were  developed  earlier  in 
the  ISD  process.  Each  test  should  be  clearly  labeled  according  to 
section  and  lesson.  .Answers  should  appear  either  on  the  tests  or  on 
a separate  sheet  of  paper  for  reference  by  the  instructor.  Additionally, 
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reference  to  the  learning  objectives  tested  by  the  Items  should  bo 
noted.  It  Is  also  important  to  Include  clearly  written  directions  for 
administering  the  tests.  All  tests  must  be  administered  according  to 
the  specifications  dictated  hy  the  test  designer.  Following  specified 
directions  on  administering  a test  insures  that  all  students  have  the 
same  advantage.  One  last  consideration  for  inclusion  in  the  section  on 
tests  is  the  evaluation  of  the  tests.  Rating,  scoring,  and  weighting 
procedures  should  be  explained  and  illustrated  so  that  the  instructor 
can  properly  determine  the  results  of  the  students'  tests. 

2.5. 1.4  Administration  Directions 

Directions  for  administering  the  course  Involve  all  details  and 
directions  for  orienting  the  students  to  the  training  situation.  This 
will  include  listing  materials  required  by  the  students  and  directions 
on  how  the  instructor  can  optimize  training.  The  following  l.sts  some 
of  the  types  of  information  that  will  enable  the  instructor  to  make 
maximum  use  of  the  training  situation: 

1.  Scheduling  procedures 

2.  Procedures  for  handling  individual  trainee  differences 

3.  Monitoring  processes 

4.  Procedures  for  keeping  the  student  productively  involved 
in  the  learning  process 

5.  Recommendations  for  handling  exceptionally  fast  or  slow 
students 

6.  Recommendations  for  providing  an  environment  conducive 
to  learning 

7.  Teaching  tips,  methods,  and  techniques 


2C6 

2,5  2 Prepare  Students 1 Guide 

The  amount  o?  information  required  In  the  Students'  Guide  depends 
on  the  course  management  plan  and  on  the  complexity  of  the  course.  For 
a relatively  simple  Instructor  managed  course,  only  minimum  Information 
will  be  required.  On  the  other  hand,  for  a correspondence  course  where 
the  student  never  comes  Into  direct  contact  with  the  Instructor,  quite 
extensive  instructions  will  be  required. 

The  major  Intent,  in  preparing  a Students'  Guide  is  to  make  sure 
the  student  has  all  the  information  he  needs  to  proceed  in  an  orderly 
manner  through  the  course  materials.  Details  of  these  instructions 
should  provide  answers  to  questions  such  as,  but  not  limited  to,  the 
following: 

1.  When  do  I begin  the  course? 

2.  What  do  I do  first? 

3.  What  do  I need  in  order  to  begin  th?  course? 

4.  What  am  I supposed  to  accomplish? 

5.  How  will  I know  if  I have  accomplished  the  objectives? 

6.  If  I fail,  how  will  I know  what  I did  wrong? 

7.  What  will  I be  able  to  do  when  I successfully  complete 
the  course? 

8.  What  do  I do  if  I do  not  understand  the  course  materials? 

9.  What  do  I do  if  I do  not  understand  some  of  the  instructions? 

10  The  course  seems  to  require  some  materials  that  I do  not 

have,  what  do  I do  now? 


i 

i 
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3.0  OUTPUTS 


The  outputs  of  this  block  should  Include: 

3.1  Products 

1.  The  completed  Instructional  program  Including  all  revised 
and  developed  materials. 

2.  Complete  instruction  for  using  the  instruction  (see  examples). 

3 . 2 Other  Documenta t ' on 

1.  An  outline  statement  of  the  instructional  development  plan 

2.  A summary  statement  of  any  deviations  from  plan,  and  reasons 
for  the  deviations 

3.  A final  report  identifying  Jevelopment  costs,  time,  etc. 
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EXAMPLES 

1.  FOJT: 

Set;  U.S.  Army  Signal  School  Signal  Subcourse  OOQ 
(OJT  Only),  Radio  Set  AN/PRC  - 77.  (exerpts  follow 
on  pages  271-275.) 

2.  Study  Cards: 

For  the  learning  objective  on  ship  recognition, 
study  cards  were  chosen  in  Block  III. 2.  (See  Illus- 
tration on  page  269.) 

3.  Audio-Visual: 

To  continue  with  the  Helicopter  Maintenance  example 
see  TEC  Bessler  Que/See  lesson  No.  600-001-6651  F, 
“PMD  Preparation  nose  cabin  and  Landing  Gear," 
with  student  Instruction  sheet  and  administrators 
guide. 

4.  Print: 

interservice  Training  on  Construction  Equ1pr.it  t 
series  published  by  the  U.S.  Army  Engineer  School  at 
Ft.  Belvoir,  Virginia,  with  Student  Workbooks  and 
Plan  of  Instruction. 
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SIGNAL  SUBCOl'iJSE  OOO  (OJT  ONLY) 
RADIO  SET  AN/PRC-77 


SIGNAL  SUBCCURSE  QQQ  (OJT  ONLY) 

introduction 


Tins  subcocrse  contains  twee  lessons  on  Radio  Set  AN/PRC-77,  These  les- 
SCWS  WILL  ENABLE  YOU  TO  ASSEMBLE  AND  INSPECT  THE  F.TC-77,  PRESET  THE  PRC-77 
TO  TOO  SPECIflC  FREQUENCIES,  AND  TO  PERFORM  A COMPLETE  OPERATIONAL  CICCK  OF 

the  PRC-77.  Each  lesson  has  a perfori-yance  tfjcf  and  there  is  no  separate 

EXAMINATION  FOR  THE  OVERALL  SUECOURSE.  You  MUST  CORRECTLY  PERFORM  EACH 
TASK  ON  AIJL  THREE  PERFORMANCE  TESTS  TO  SATISFACTORILY  COMPLETE  THU  SUBCOURSE. 

This  subcourse  is  to  be  administered  by  an  appointed  monitor  who  is  knowl- 
edgeable OR  SKILLED  IN  THE  SUBJECT  MATTER  WHICH  IS  COVERED.  THE  MONITOR 
IS  RESPONSIBLE  FOR  CERTIFYING  THAT  THE  STUDENT  HAS  SATISFACTORILY  PASSED 
EACH  PERFORMANCE  TEST. 

WFORNT’ON  FOP.  UNIT  CCWANDEKS 

Your  cooperation  and  assistance  is  needed  for  the  student  to  success- 
fully COMPLETE  THIS  SUBCOURSE.  YOU  ARE  TO  PROVIDE  A MONITOR,  WHO  IS  KNOWL- 
EDGEABLE OR  SKILLED  IN  THE  SUBJECT  MATTER,  TO  SUPERVISE  TFE  CUT  SUBCCURSE. 
YOU  ARE  ALSO  TO  PROVIDE  THE  NECESSARY  EQUIPMENT.  A COMPLETE  AN/PRC-77  AND 
ACCESSORIES  IS  NEEDED  FOR  THIS  TRAINING.  THE  STUDSTT  WILL  BE  GIVEN  CREDIT 
FOR  COMPLETION  OF  THIS  SUBCOURSE  WHEN  YOU  CERTIFY  THAT  THE  PERFORMANCE 
TESTS  HAVE  BEEN  PASSED.  USE  THE  LESSON  VERIFICATION  SHEET  AND  SUBCOURSE 
Certification  Letter  contained  in  this  subcourse  booklet  to  certify  this 

ACTION.  ThC  SUBCCURSE  CERTIFICATION  I.E7 HER  IS  TO  BE  MAILED  TO  THE  l^iTED 

States  Aw  Signal  School  and  the  Lesson  Verification  Sj-eet  shou/d  be 

INCLUDED  AS  AN  INCLOSURE. 
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INFORMATION  FOR  STUDENT 

This  subcourse  is  designed  to  provide  hands-on  training  on  Radio 
Set  AN/PRC-77 . Tie  lessons  consist  of  practical  exercises  which  are 

PERFORMANCE  ORIENTED,  YOU  MUST  HAVE  ACCESS  TO  RADIO  SET  N\/W~77 
TO  PERFORM  THESE  EXERCISES,  YOU  MUST  ALSO  WORK  UNDER  THE  SUPERVISION  OF 
A MONITOR,  The  MONITOR  WILL  CERTIFY  YOUR  SUCCESSFUL  COMPLETION  OF  THE 

O.IT  SLBCfHJRSE.  See  your  Platoon  Leader  to  make  arrangement  s to  have 

Av^tSS  TO  THE  EQUIPMEfT  AND  TO  HAVE  A MONITOR  ASSIGNED  TO  CERTIFY  YOUR 
TRAINING. 

When  you  have  finished  working  through  each  iesson  and  you  are 

READY,  ASK  YOUR  MONITOR  TO  GIVE  YOU  THE  LESSON  TEST,  Fj'/E  CREDIT  HOURS 
WILL  BE,  AWARDED  FOR  SATISFACTORY  COMPLETION  OF  TIE  SUBCOURSE  WHEN  TIE 
LETTER  OF  CERTIFICATION  IS  RECEIVED  AT  USASIGS,  B,'  SURF  THAT  THE  LESSON 
VERIFICATION  SHEET  AND  THE  LETTER  OF  CERTIFICATION  ARE  PROPERLY  FILLED 
OUT  AND  CONTAIN  THE  REQUIRED  CERTIFY’ NG  SIGNATURES. 

This  subcourse  does  not  have  to  be  completed  within  a specific  time 

PERIOD,  r I IS  TO  BE  COMPLETED  AT  THE  CONVENIENCE  OF  IH^  MONITOR  AND 
S.TIDENT,  DEPENDING  UPON  THF.  AVAILABILITY  OF  THE  EQUIPMENT. 
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Inspect,  Clean,  and  Assemble  Radio  Set  AM/PRC-77 

OBJECTIVE 

Action:  At  tic  end  of  this  lesson  you  will  be  able  to  inspect, 

Cl£AN,  AND  ASSEMBLE  RuiIO  SgT  M/PRC“77. 

Conditions:  You  will  have  a ccf.n  tTE  Radio  Set  AN/PRC -77,  TM  11- 

5820-667-12,  and  this  su3course  booklet  and  you  will  work 

UNDER  THE  SUPERVISION  OF  THE  TEST  MONITOR, 

Standards:  Within  a time  limit  of  30  minutes  you  must  be  able  to 

r’-’ECT,  CLEAN,  AND  ASSEMBLE  THE  AN/PRC“77.  AFTER  COM- 
PLETING THE  LESSON  YOU  WILL  BE  GIVEN  TWO  CHANCES  TO  PASS 
THE  PERFORMANCE  TEST  BEFORE  YOU  WILL  BE  REQUIRED  TO  RE- 
PEAT T. E COMPLETE  LESSON. 

INSTRUCrKyAI-  jgmg 

1.  Mimmotl. 

The  PRC-77  .is  a short  range,  man-packfd,  portable  radio  recover 

TRAN-Sf  iITTER  USED  FOR  TWO  WAY  CQMMWICATION,  II  IS  IDENTICAL  TO  THE 

Radio  Set  AN/PRC-25  except  that  the  PRL-77  is  fuly  transistorized,  has 

IMPROVED  TRANSMISSION  CAPABILITY  AND  CAN  PROVIDE  VOICE  (X~MDDE.)  TRANS- 
MISSION. YOU  ARE  GOING  TO  LEARN  HOW  TO  PERFORM  SEVERAL  TASKS  ON  THE 
PRC-77  DURING  THIS  I ESSON,  SO  LET'S  GET  STARTED. 
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1.  Job  Performance  Order.  One  method  of  sequencing  is  in  the  order 
in  which  tasks  and  elements  are  performed.  The  learning  sequence 
is  the  same  as  the  job  sequence.  For  example,  a gunner  may  learn 
to  load,  aim,  and  then  fire  his  weapon. 

2.  Chronological  Order.  The  content  of  instruction  flows  from  topic 
to  topic  on  the  basis  of  the  order  in  which  the  events  covered 
occurred  in  time.  For  example,  recruits  may  be  taught  about  World 
War  I,  then  World  War  II,  then  the  Korean  War,  and  finally  the 
war  in  Vietnam. 

3.  Cause  and  Effect  Order.  Learning  objectives  are  sequenced  from 
cause  to  effect.  For  example,  the  causes  of  low  unit  morale 
(poor  leadership,  inability  to  function  as  a team),  may  preceed 
the  effects  of  low  unit  morale  (abst.  ieeism,  motivation  problems). 

4.  Critical  Sequence.  Learning  objectives  are  ordered  in  terms  of 
their  relative  Importance.  For  example,  a first  aid  course  may 
address  potentially  fatal  Injuries,  then  permanently  disabling 
injuries,  and  finally  minor  injuries. 

5.  Simple  to  Complex.  Learning  objectives  may  be  sequenced  in  terms 
of  increasing  complexity.  For  example,  marine  navigation  based  on 
buoys  and  landmarks  may  be  taught  before  navigation  based  on  the 
location  of  stars  or  the  angle  of  the  sun. 

6.  Comparative  Sequence.  Familiar  tonics  are  considered  before  un- 
familiar ones.  Submariners  should  study  familiar  American  sub- 
marines before  attemptmq  to  study  the  more  exotic  midget  sub- 
marines developed  by  Germany  and  Britain. 

7.  Reward  Sequence.  Unpleasant  scvivities  should  preceed  more  plea- 
sant activities.  For  example,  the  difficult  and  tedious  objective 
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involving  pre-setting  the  AH/PRC-77  radio  should  come  before  the 
enjoyable  social  activity  of  establishing  cocrounications  with 
other  stations. 

You  have  undoubtedly  noticed  that  several  of  these  sequencing  tech 
nlq'jes  are  easily  reversed.  Learning  objectives  may  be  ordered  in 
reverse  chronological  order,  or  from  effect  to  cause,  or  from  least 
critical  to  most  critical.  These  are  valid  sequencing  approaches  and 
worthy  of  consideration.  The  best  sequence  is  the  one  that  works  on 
the  students  for  which  It  was  designed. 
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OVERVIEW 


The  heart  of  the  developmental  phase  is  validating  the  instructional 
materials  until  the  studants  who  use  the  materials  as  planned  meet  the 
learning  objectives.  Validation  is  an  iterative  process  and  not  a 
single  point  at  which  to  measure  success  or  failure.  It  is  a formative 
evaluation;  that  is,  it  Is  part  of  the  process  of  developing  and  imp'-ovinq 
the  instructional  materials  and  procedures. 


251 


I 

| 

i 

i 


I 

I 


I 


L 


L • if 


VA1IDATE  INSTRUCTION 
1.0  INTRODUCTION 

There  Is  a tendency  among  people  who  are  being  introduced  to  the 
ISO  prccess  for  the  first  time  to  ask— "So  what's  new?  As  an  Instructor 
I have  been  doing  all  this  for  a long  time,"  While  there  are  many  steps 
In  the  process  whi-*  aro  unique  to  ISO,  probably  the  most  significant 
step  which  distinguishes  ISD  from  other  methods  of  instruction  is  the 
step  of  validating  instruction.  It  is  one  of  the  few  distinct  steps  In 
ISO  where  there  is  a clear  distinction  between  art  and  technology— and 
validating  instruction  is  definitely  a technology. 

The  validation  process  (often  called  formative  evaluation),  if  prop- 
erly followed,  will  ensure  that  instruction  works.  That  Is,  It  will 
ensure  that  members  of  the  target  population  will  achieve  the  objectives 
after  Instruction.  This  is  a strong  claim.  However,  no  other  technique 
has  been  reported  in  the  literature  that  consistently  ensures  results  in 
all  kinds  of  courses,  for  all  kinds  of  trainees,  In  virtually  all  kinds 
of  circumstances.  Further,  there  is  nothing  mystical  about  validating 
instruction  and  people  can  learn  to  do  it  with  only  a modest  amount  of 
training.  In  a sense,  It  resembles  the  method  of  adjusting  artillery 
fire  by  the  bracketing  process.  Fire,  and  adjust.  Fire,  and  adjust. 

The  process  is  repeated  until  vhere  Is  fire  for  effect,  then  adjusted 
again  until  the  target  is  hit. 

By  the  time  instruction  is  ready  for  validation,  many  things  have 
become  fairly  clear:  What  the  learning  objectives  and  tests  are  l*ke, 
what  the  Instructional  materials  are  liko,  how  the  Instruction  is  intended 


to  produce  the  expected  results,  and  the  characteristics  of  the  target 
population  for  whom  the  instruction  Is  intended.  VSiat  remains  to  be  done 
is  to  try  out  the  instructive  on  members  of  the  target  population  and 
revise  it  until  It  works --until  the  trainees  achieve  the  learning  ob- 
ject! ves. 

The  most  important  single  assumptin  made  in  this  block  probably  will 
be  the  most  difficult  for  people  new  to  the  ISD  process  :o  understand 
and  accept: 

THE  FIRST  TRYOUT  OF  A LLJSON  OR  MATERIALS 
SHOULD  REVEAL  AN  ABUNDANCE  OF  ERRORS;  IV 
SHOULD  NEVER  PASS  WITH  FLYING  COLORS. 

If  it  sounds  like  this  step  in  the  ISD  process  is  one  In  which  you 
plan  ahead  to  fail,  this  is  true  to  a point.  The  necessity  for  producing 
inadequate  instruction  on  the  first  trial  is  caused  by  a peculiarity 
in  the  measurement  process.  While  it  is  relatively  easy  to  detect  and 
revise  instruction  that  only  partially  meets  the  requirements,  it  is 
virtually  impossible  to  identify  and  revise  Instruction  that  grossly 
exceeds  the  requirements.  It  is  possible  to  identify  too  little  instruc- 
tion, but  not  possible  to  obtain  data  that  enables  one  to  conclude  there 
Is  too  much. 

A thorough  understanding  of  this  point  Is  essential  to  the  correct 
application  of  the  ISD  process.  The  importance  if  this  point  is  further 
emphasized  by  costs.  It  is  far  more  expensive  to  try  to  eliminate  portions 
of  instruction  that  have  already  been  developed  and  designed  into  the 
program  than  it  is  to  adc  smell  amounts  of  additional  Instruction  where 
<t  is  fo'ind  to  be  needed  basi  d on  tryouts. 
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You  might  ask.  If  the  validation  process  Is  so  good,  why  are  people 
just  now  getting  around  to  using  it.  The  answer  would  be  that  many  people 
have  been  using  it  for  years;  however,  two  Important  factors  are  now 
making  its  use  much  more  wldespiead.  First,  the  strong  pressure  to  produce 
more  and  better  Instruction  has  forced  instructional  designers  to  look 
for  more  and  better  tools.  And  the  validation  process  provides  a very 
powerful  tool.  Second,  hopefully  enough  has  been  learned  about  the  vali- 
dation process  to  do  a more  effective  job  of  teaching  others  how  to  use 
it. 

Very  few,  if  any,  ISO  professionals  have  the  ability  to  look  at 
instruction  of  any  kind  and  tall  whether  it  was  producer'  by  ISO  or  by  a 
traditional  process.  If  you  walked  into  a lecture  class  or  a demonstra- 
tion, or  examined  manuals,  TV  tapes,  or  other  learning  materials,  you 
would  be  unable  to  tell  by  looking  at  the  object  itself,  whether  it  was 
properly  designed  by  IS3  or  simply  selected  on  the  basir  of  someone's 
personal  opinion.  This  statement  is  extremely  important  because  the 
typical  method  of  examining  or  "inspecting"  instruction  is  one  of  having 
"experts"  look  or  listen  to  the  instruction  and  then  offer  their  personal 
opinion  of  its  adequacy.  The  supervisor  goes  into  the  classroom  and 
observes  the  instructor  going  through  a well -rehearsed  presentation,  then 
he  makes  out  an  evaluation  form. 

Unfortunately,  this  personal  opinion  method  of  examining  or  inspect- 
ing instruction  is  a tendency,  a strong  practice,  and  is  called  for  by 
regulation  and  doctrine.  It  does  not  constitute  ar.  adequate  measurement 
of  the  variables  in  the  instructional  setting.  If  the  purpose  of  instruc- 
tion is  to  change  the  behavior  of  the  students,  determination  of  wheth°r 
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or  not  that  purpose  has  been  met  cannot  be  made  on  the  basis  of  observation 
of  the  materials  and  presentations.  The  only  known  way  that  it  can  be 
dene  Is  to  examine  In  detail  the  responses  of  the  learners  on  the  criterion 
tests.  If  they  have  learned, as  a result  of  the  instruction,  the  instruction 
must  be  working,  and  if  they  have  not  learned,  the  instruction- -no  matter 
how  polished  and  powerful  it  appeared--must  not  be  working. 

This  is  a difficult  position  to  accept  because  all  of  us  "hink  of 
ourselves  as  judge*  of  "good"  1nstruction-~materials , films,  etc. --and 
to  be  told  that  these  judgements  are  not  valid  and  reliable  is  a sort  of 
slap  in  the  professional  face.  Typically,  instructional  developers  have 
been  taught  and  have  come  to  accept  the  notion  that  if  the  students  did 
not  learn,  the  students  were  somehow  at  fault.  That  was  a convenient 
rationalization.  Unfortunately,  it  is  no  longer  an  acceptable  excuse 
for  failing.  The  people  in  the  target  population  are  the  ->nly  people 
we  have  to  work  with,  and  if  we  are  unable  to  teach  them  what  they  need 
to  know  in  order  to  perform,  the  instruction  is  at  fault  and  must  be 
revised.  The  validation  process  is  the  method  by  which  the  instructional 
developer  makes  instruction  work. 

As  was  said  earlier,  the  instruction  should  have  been  designed  to 
be  barely  acceptable  or  barely  unacceptable,  with  the  preference  going 
to  the  latter.  It  should  be  tried  sequentially  on  increasingly  larger 
groups.  The  purpose  of  the  individual,  small,  and  large  group  trials 
is  to  find  and  eliminate  errors  and  inadequate  or  wrong  instruction. 

Since  it  is  assumed  tnat  there  will  be  a large  nirmber  of  errors  or  problems 
in  the  early  versions  of  the  instruction,  the  tryout  procedure  is  designed 
to  take  advantage  of  the  notion  that  the  more  errors  you  have  to  find, 
the  fewer  students  you  will  need  to  find  them 
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There  Is  a good  reason  for  this.  Errors  and  problems  in  Instructional 
materials  are  usually  not  unique  to  single  individuals.  Suppose  nn 

M 

Instructional  sequence  was  available  in  which  there  were  fifty  r-oblems 

■i 
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will  make  the  same  mistake.  If  all  students  would  have  maoe  that  mistake, 
only  one  student  is  needed  to  find  it.  A<  indlv.dual  students  go  through 

i ’ • 

« 

the  materials  they  grad-ally  eliminate  all  the  obvious  problems,  and  more 
students  are  needed  to  find  the  remaining  ones.  So,  a few  irore  students 

U, 

are  added  for  the  small  group  trials.  By  the  end  of  the  smal . group  trials  1 

y } 

» ■■ 

m ■: 

all  the  errors  and  problems  that  can  be  found  by  using  small  groups  have 

-- 

-A 

| ..  ; 

been  found  and  corrected.  At  this  point,  a larger  group  of  people  is 

r * 
K : : 

1 

needed  to  find  any  more  errors  or  problems  that  may  exist. 

This  procedural  order,  fortunately,  is  very  cost  effective.  The 

[■' 

early  versions  of  the  materials  can  be  fairly  rougn  and  stili  provide 
good  data,  eliminating  the  need  for  expensive  flna1  draft  artwork  and 

editorial  efforts. 

Tne  stfios  'n  validatino  materials  are  shown  in  Finnrp  ITT  ?1  the 

* 

r’i'.i  - 

fold-out  page  at  the  end  of  this  block. 

: ' . 

2.0  faOCEDUiiES 

fcv. 

2.1  Develop  Plan  for  Individual  Tnals  

• ■_>  * 

The  validation  procedure  requires  that 
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all  instruction  be  testta  with  students  before  ^ 1 

it  is  used  in  actual  course  settings,  (.’early,  _ j i j "l-| 
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this  is  the  recommended  proceduie.  However,  1 , i I 
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the  realities  of  day-to-day  management  often  > 

Cl 

require  adjustments  and  nadiflcatiuns  of 

V} 
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this  Is  the  recommended  proceduie.  However, 
the  realities  of  day-to-day  management  often 
require  adjustments  and  rujdiflcatluns  of 
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procedures.  If  there  Is  an  Intense  need  for  trainees «$n  the  field  and 
It  would  be  possible  to  begin  a training  cycle  using  untested  materials, 
some  circumstances  could  justify  this  approach. 

First,  there  would  have  to  be  enough  instructors  to  provide  addi- 
tional opportunities  for  students  to  receive  help.  Second,  students 
should  have  the  opportunity  to  be  retested  on  any  materials  they  failed 
to  master  the  first  time.  Third,  the  materials  will  be  revised  based 
cn  the  data  collected  during  tne  first  class  or  group  of  actual  students. 

The  necessity  to  use  such  a procedure  will  often  arise  when  there 
are  Insufficient  members  of  the  target  population  available  to  do 
reasonable  testing  prior  to  the  time  the  actual  trainees  arrive.  Re- 
member, the  groups  which  are  used  in  the  validation  process  define  the 
target  population  for  the  materials.  If  no  mergers  are  available  for 
testing,  better  long  term  results  could  be  obtained  by  revising  after 
the  first  true  members  of  the  population  are  available.  However, 
whenever  possible,  the  procedures  covered  next  should  be  followed. 

When  a course  is  under  development,  the  materials  and  instruction 
normally  will  be  developed  in  the  same  sequence  that  they  will  be  used, 
particularly  if  subsequent  seqments  or  units  depend  on  mastery  of  the 
earlier  materials.  If  there  is  a sequence,  how  is  it  known  when  to 
start  the  tryout  process?  There  is  no  universal  answer  for  this 
question.  However,  there  are  some  Guidelines  which  should  be  helpful 
in  making  decisions. 

I.  If  the  developers  have  not  worked  in  the  area  before,  it  is 
probably  a good  idea  to  try  out  early  and  frequently  until  you  learn  the 
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likely  problem  areas.  Perhaps  testing  the  first  thirty  minutes  of  In- 
struction Is  a good  approach.  The  unit  of  Instruction  should,  however, 
be  large  enough  and  complete  enough  to  make  sense  alone. 

2.  Later  In  the  developmental  process,  you  may  safely  wait 
until  a larger  amount  of  material  has  been  developed,  but  not  more  tha.i 
can  be  comfortably  done  by  a student  In  one  sitting. 

3.  When  the  materials  are  hierarchically  related,  you  will  have 
to  insure  tnat  the  student  has  mastered  all  of  the  early  dependent 
segments  before  he  takes  the  later  segments.  This  may  mean  you  will 

have  to  bring  all  the  students  up  to  criterion  on  the  early  lessons  before 
the  later  ones  can  oe  started.  This  is  a very  difficult  and  time  consuming 
process . 

4.  It  is  difficult  for  an  individual  student  to  complete  more 
than  four  lessons  It.  one  day  (or.e-half  to  one  hour  In  length)  as  a part 
of  a tryout  effort.  This  is  not  an  absolute  rule,  just  an  apnroxlmation 
based  on  experience. 

5.  If  lessons  are  independent,  you  can  reasonably  test  more  of 
them  in  one  day  than  you  can  if  they  are  dependent.  Still,  It  Is  probably 
best  to  test  only  one  or  two  on  the  same  students  unless  there  Is  a real 
difficulty  In  obtaining  test  students. 

2.1.1  Select  or  Develop  Data  Collection  and  Recording  System 

The  purpose  of  the  trials  are  to  find  out  information  about  the 
students  the  materials,  and  the  procedures.  You  must  have  a system 
for  collecting  and  recording  the  data  so  that  decisions  can  be  made 
based  on  the  data.  There  is  no  point  in  collecting  particular  data  unless 
you  intend  to  use  it.  Start  with  a list  of  all  the  decisions  to  be  made. 
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then  the  kinds  of  Infomatlon  needed  to  make  them,  decide  how  to  collect 
and  display  the  Information,  and  fii.jlly,  decide  how  to  analyze  the  data. 
Usually  you  will  need  data  such  as  background  Information  on  students, 
(Figure  111.22} , pretests  (Figure  I I I. 23),  entry  level  tests,  attitude 
measures  (Figu.e  111.24),  withln-course  test  1 terns  or  responses,  validator's 
conroents  to  students  (Figure  III. 25),  student  questions  and  remarks 
(Figure  111.25),  length  of  time  required  on  different  parts  of  the 
instructional  "rugram  (Figure  111.25),  posttests,  and  Interviews  (Figure 
III. 26). 

2.1.2  Select  or  Develop  Attitude  Measures 

The  attitudes  you  are  interested  In  may  vary  widely.  They  may  be 
simply  whether  the  students  liked  or  disliked  the  subject  matter.  Or, 
they  can  Include  usefulness  of  the  medium,  or  feelings  about  the  medium, 
the  procedures,  or  the  length.  Do  not  measure  an  attitude  just  for  its 
own  sake.  Measure  only  those  on  which  decisions  or  revirions  will  be 
made.  Figure  III. 24  shows  an  example  of  attitude  scales. 

If  you  want  to  determine  whether  the  students  feel  the  course  is 
too  long  or  too  difTicult,  word  the  items  so  the  students  can  respond 
in  a range  of  ways.  Provide  for  positive,  negative  and  neutral  positions. 
Both  the  student  and  the  scorer  need  to  be  able  to  tell  whether  It  is 
a positive  or  a negative  response. 
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rs  Completely  ‘ 


TIME  IN  SEW  ICE 


COMPLETED  BASIC  TRAINING: 


PRESENT  DOS 


YES NO 

(Check  One) 

TIME  IN  DOS 


(Years f 


(Months  f 


TITLE  OF  YOUR  PRESENT  JOB 


TIME  IN  PRESENT  JOB 


CYeirsT  (Months)' 


SECONDARY  DOS 


SCHOOL  TRAINE  > IN  SECONDARY  DOS:  YES  NO 

(Check  One] 


FIGURE  II 1. 22:  Background  Information  Sheet 
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ACTIVITY  EVALUATION  FORM 

Date, ... 

Activity  (check  one  and  write  in  the  title): 

Lecture 

Game _ 

STEP 

Exercise 

Discussion 

Student  Presentation __ 

Other_ 

Please  mark  your  response  to  each  statement  with  an  Mx"  »t  the  appropriate 
place  on  the  scale. 

1.  The  activity  helped  me  achieve  the  criterion  on  the  learning  objectives. 

Yes  Some  Help  No 

h -H 1 • * 1 

2.  crom  the  activity,  I learned  skills  that  I expe  t to  use  on  my  job. 

Yes  Maybe  N~j 

1 J 1 ♦ 1 

3.  This  activity  was: 

Too  Too 

Simple  Average  Complicated 

j , , , , 

4a.  I would  have  preferred  a.:  alternate  activity  to  achieve  the  same 
learning  objectives. 

Yes  Maybe  No 

I 1 1 1 ! 

4b.  What  would  you  nave  preferred? 


1 


J 

? 


3 


'i 


FIGURE  111.24:  Attitude  Measure 
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.25:  Wtthin-Course  Response  ai 
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INDIVIDUAL  POST-LESSON  INTERVIEW 
(For  a slide/tape  lesson) 


Questions 

Responses 

1. 

How  was  the  lesson's  pace: 

Fast  Slow  OK 

_? 

2. 

How  was  the  visual  art: 

OK  Not  OK 

? 

3. 

Were  the  words: 

Confusing  Clear 

_? 

4. 

How  was  the  narrator: 

OK  Not  OK 

? 

S. 

How  were  the  procedures : 

Confusing Clear 

? 

o. 

Did  you  find  the  word:  on  the 
visuals: 

Bothersome  OK 

? 

7. 

Was  it  a boring  lesson: 

Yes  No 

? 

8. 

Did  you  feel  "pressure”: 

Yes  No 

? 

9. 

Do  you  think  platform  instruction 
would  be: 

Better Worse Same 

? 

10. 

Were  the  practice  exercises: 

Too  many 
Too  few 
About  right 

11. 

How  confident  of  your  performance 
are  you: 

Very  Little 

(Degree  ) 

12.  Do  you  have  any  general  overall  statements  about  the  entire  lesson 
experience? 


FIGURE  I II. 26:  Post  Lesson  Interview 
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EXAMPLE 


Amount  of  required  revision  to  improve  usefulness: 


I “ 2 T 5 

very  high  satisfactory  low  very 

hi  git  neutral  low 

The  students  were  unable  tc  determine  whether  a "high" 
meant  that  much  revision  was  required,  or  the  "h1g!'.B 
was  a positive  meaning  that  it  was  adequate  and  needed 
little.  If  any,  revision. 


Vo  help  make  optimum  use  of  the  attitude  measures,  develop  a parti- 
cipant debriefing  Interview.  Immediately  after  completing  the  lesson, 
the  student  is  a good  source  of  information  about  how  he  feels  about  the 
lesson.  Ask  him  about  problems  he  had  with  any  parts  of  the  lesson. 

A oart.al  list  of  possible  questions  Is  shown  In  the  following  example. 


EXAMPLE 


1.  What  were  the  most  difficult  parts  of  the  lesson  for 
you? 

2.  Do  you  have  any  ideas  on  how  to  make  any  of  thost 
parts  easier  or  clearer’ 

3.  ttiat  parts  of  the  postt  st  were  difficult  for  you? 

4.  Did  you  have  problems  on  the  same  parts  of  the  lesson? 

5.  Was  the  Lest  different  from  the  lesson?  How? 

6.  kfoat  was  the  best  feature  of  the  lesson? 

7.  Whut  was  the  worst  feature  of  the  lesson? 


In  addition  to  questions  that  apply  to  most  lessons,  which  can  be 
prepared  in  advance,  nrte  things  during  the  trial  that  you  want  to  ask 
the  student.  Write  them  down  and  odd  them  to  the  debriefing  as  the 
lesson  goes  along,  or  whlie  the  student  is  taking  the  posttest. 
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Since  each  lesson  Is  unique,  there  Is  little  likelihood  that  a 
standardized  fora  can  be  used  for  all  lessons.  Remember,  these  are  all 
'■wjrklng  documents,  not  control  doctmients.  Ir.  addition  to  written  instru- 
ments, some  data  may  be  collected  on  audio  or  video  tape. 

2.1.3  Develop  Data  Analysis  Plan 

No  data  has  any  value  unless  they  arc  usable  and  used.  For  Individual 
trials,  you  usually  are  deallrg  with  detailed  information  from  a few  people. 
For  each  piece  of  data  to  be  collected,  decide  what  it  will  tell.  If  you 
ask  the  students  If  the  lesson  was  too  long,  too  short,  or  just  right  and 
they  all  say  “too  short"--what  are  you  going  to  do  with  that?  You  need 
to  determine  ahead  of  time  how  you  will  make  decisions  based  on  the  sum- 
marized data.  If  you  do  not  know  how  the  data  will  be  used,  you  probably 
dc  not  need  to  collect  It. 

In  Block  Ii.2,  test  Iters  were  developed  to  decide  whether  a student 
had  cr  had  not  mastered  each  learning  objective.  These  tests  were  consis- 
tent with  the  behavior,  conditions,  and  standards  of  the  learning  obj  ctlves 
developed  in  Block  II. 1.  Those  learning  objectives  and  tests  are  now 
to  be  used  in  determining  whether  the  Instructional  materials  are  adequate. 
You  must  decide  In  this  block  how  good  the  Instruction  must  be  before 
It  will  be  Implemented  In  the  field. 

How  good  it  must  be  will  depend  on  a wide  variety  of  considerations, 
such  as  the  follrwlng: 

1.  If  there  will  be  much  Instructional  support,  additional  or 
alternative  materials,  many  instructors,  ample  time,  etc.,  the  Instruction 
does  not  have  to  meet  as  high  a standard  as  when  It  must  stand  alone. 
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2.  If  the  course  will  only  be  offered  once  to  each  strd^nt 

and  the  need  Is  for  a high  proportion  passing,  the  materials  must  be  much 
better  than  If  the  need  Is  only  for  a low  proportion  passing. 

3.  If  the  student  has  many  opportunities  to  repeat  Instruction 

* 

and  tests,  or  alternative  Instruction  and  tests,  the  standards  do  not 
have  to  be  as  hi as  if  he  does  not  have  the  chance  to  repeat. 

4.  The  standards  set  for  Instruction  win  depend  to  a large  extent 
on  how  decisions  will  be  made  to  graduate  students  from  the  course.  If 
the  student  must  take  a complete  course  mastery  examination  upon  com- 
pletion of  Instruction,  standards  must  be  higher  than  If  he  must  pass 

only  a part  of  the  objectives. 

i 

Remember  that  In  thin  block  you  are  trying  to  improve  the  Instruction 
so  that  a sufficiently  high  Dercentage  of  students  will  meet  the  criteria 
on  the  posttest  their  first  time  through  the  course.  You  are  not  deciding 
the  percentage  of  students  that  will  eventually  meet  all  the  course  ob- 
jectives. 

The  higher  you  set  the  standards  for  the  instruction,  the  more 
expensive  it  will  be  and  the  urger  it  will  take  to  have  the  course 
operational.  If  you  want  80  percent  of  the  students  to  meet  the  cri- 
terion the  first  time  the  instruction  Is  offered,  it  will  cost  consid- 
erably more  than  if  you  can  be  satisfied  with  70  percent,  rurthet,  if 
the  standards  are  set  as  high  as  90  percent,  It  will  take  much  longer 
and  cost  more  than  to  accept  80  percent.  It  takes  more  effort  and  time 

to  move  from  90  percent  to  90  percent  than  it  does  .rom  70  percent  to 

1 & 

| 80  percent.  This  is  a finding  that  is  totally  consistent  with  quality 

I 

A control  data  from  other  disciplines. 
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Remember  that  the  standard  for  each  learning  objective  was  estab- 
lished In  Phase  II.  Unless  ther.  are  serious  reasons  to  question  those 
criteria  here,  they  should  be  accepted  as  good  working  numbers , even 
though  they  may  have  been  more  or  less  arbitrarily  picked  when  they  were 
written  in  II. 2.  Later,  as  uata  are  accumulated.  It  may  he  reasonable 
to  discuss  with  the  test  writers  the  advantages  and  disadvantages  of 
changing  the  criterion  on  any,  or  all,  of  the  objectives.  This  discussion 
should  be  based  on  experience  gained  in  the  tryouts. 

Wi chin-course  tests  present  a different  problem.  You  may  develop 
a sliding  scale  of  standards  from  wlthin-course  tests  to  the  posttest. 

For  example,  while  the  posttest  will  need  to  reflect  the  original,  or 
revised,  learning  objective  standard,  you  may  have  several  tests  within 
the  course  prior  to  the  posttest.  On  these  within-course  tests,  you 
may  accept  a ’ower  level  of  performance  in  the  earlier  tests,  with  the 
acceptable  level  being  raised  on  subsequent  tests  until  the  actual 
learning  objective  standard  is  reached  on  the  final  test. 

2.1.4  Develop  Plan  for  Conducting  Instruction 
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7.  If  the  results  in  either  4 or  6 indicate  the  participant 

is  not  from  your  target  audience,  select  another  participant. 

8.  Start  lesson. 

9.  Record  all  the  information  as  you  planned. 

10.  Administer  posttest. 

11.  Debrief  the  participant. 


2.1.5  Select  Participants 

The  participants  you  use  will  have  a tremendous  impact  on  the  learning 
materials.  The  participants  l.ecome  your  target  ?Mdience.  Some  Instruc- 
tional developers  prefer  to  use  students  who  aia  in  the  low^  portion 
of  the  population  because  they  should  make  more  errors  and  thereby  give 
more  data.  Others  prefer  brighter  than  average  people  because  they  more 
often  can  toll  why  they  made  an  error,  or  even  how  you  might  revise  the 
lesson  to  make  it  clearer.  Usually,  since  you  probably  will  <1o  several 
individual  trials,  you  wi'1  be  able  to  sample  from  several  segments  of 
the  target  audience.  Prefer Mng  them  is  assential  if  you  are  tc  have 
any  confidence  that  the  student  le  tied  from  the  4nctructional  mate  lals 
rather  than  from  prior  experience. 


2.2  Conduct  Individual  Trials 

2.2.1  Set-up  for  Trials 

The  preparation  for  actually  con- 
ducting individual  trials  will  be  dependent 
upon  the  chosen  manaoement  plan  and  delivery 
system  and  upon  what  facilities  are 
available.  Preparation  will  include  the 
fol lowing: 


1.  Select  a place  to  have  the  trials. 

2.  Arrange  for  any  required  lesson,  or  delivery  system  equipment. 

Obtain  annuals,  pencils,  paper,  etc. 

4.  Arrange  for  a tew  of  validators. 

5.  Have  sufficient  copies  of  all  the  tests  printed  or  copied. 

6.  Have  sufficient  copies  of  all  the  forms  printed  or  cooled. 

7.  Set  up  the  equipment. 

8.  Try  the  materials  out  where  tliry  will  be  used.  That 
is.  If  it  is  a slide  tape,  run  through  it  to  make  sure 
all  the  slides  are  there,  In  order,  and  right  side  up  and 
that  ueth  the  projector  and  the  tape  player  work.  If  it  Is 
a videotape,  play  It.  If  it  is  printed  material,  go  through 
It  page  by  page. 

It  Is  valuable  for  the  author  to  do  some  of  the  individual  trials. 

If  he  can  be  objective  about  the  student  responses  and  opinions,  he  can 
revise  based  on  his  own  contact  with  the  student,  however,  some  authors 
have  .oo  much  personal  Involvement  to  make  good  data  collectors. 

2,2,2  Explain  Participant's  Role  to  Him 

You  need  the  participant  to  be  a party  to  the  project.  He  needs  to 
know  his  role.  Let  him  know  he  Is  helping  to  improve  the  lesson;  that 
you  need  to  use  Ms  mistakes  as  well  as  his  successes.  He  needs  to  be 

• a 

at  ease  so  he  car.  tell  what  he  thinks  about  the  course.  You  do  not  want  > 

him  to  be  nervous  about  so  many  tests,  but  you  need  to  i,<easure  all  the 

• i 

changes.  Long  series  < lessons  at  one  time  can  be  very  tiring.  Be  sure  j 

the  student  *eels  free  to  ask  for  a break,  rest,  or  change  of  pace 
when  he  needs  It. 
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2.2.3  Implement  Data  Recording  Flan 

You  should  have  made  decisions  on  how  the  background  response 
and  test  data  will  be  recorded.  Now  follow  the  plan.  3ut,  be  flexible. 

If  something  does  not  work,  be  ready  to  change.  For  example,  If  the  tape 
recorder  doss  not  work,  switch  to  written  notes.  Do  not  lose  the  data, 
they  are  the  basis  for  decisions  that  will  affect  the  whole  In  tructlonal 
system.  Be  accurate  In  recording  and  identifying  the  data. 

2.2.4  Administer  Entry  Level  Tests  and  Participant's  Background 

Data  Collection  Inst.-ument 

Some  general  background  Information  Is  needed  about  the  participants: 
age,  amount  of  formal  schooling,  length  of  time  In  the  service,  rank, 
primary  DOS,  and  secondary  DOS,  if  any.  The  form  may  Include  name  or 
serial  number  or  only  an  identifying  number  for  trials.  Figure  1 1 1. 22 
(page  289)  is  an  example  of  such  a form. 

You  also  o/ten  need  some  lesson-specific  Information  like  prior 
experience  0"  training  on  the  lesson  objectives,  and  particular  personal 
goals  or  orders  that  are  incentives  to  use  or  do  well  on  the  lessons. 

Such  information  often  can  be  included  as  part  of  the  entry  level  test. 
Except  for  this  possible  addition,  the  entry  level  test  is  the  same  one 
that  was  developed  in  Block  II. 3. 

If  the  background  Information  collection  form  Is  to  be  filled  In 
by  the  student,  explain  the  purpose  of  the  form,  and  have  him  fill  It 
in.  If  you  have  no  need  for  permanent  records,  and  if  you  do  not  need  the 
student's  name  or  se.lal  number  to  use  in  securing  additional  information 
about  him,  use  code  numbers,  such  as  Al,  A2,  and  A3,  to  keep  each  student's 
records  together. 
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For  students  who  do  not  write  well,  consider  using  other  means  of 
recording.  If  you  are  going  to  record  the  answers  on  tape,  have  the 
recorder  ready  and  use  the  questions  as  an  interview  form,  or  if  you  are 
going  to  Interview  and  write  down  the  answers,  be  sure  to  have  the  right 
number  of  blank  forms. 

If  the  entry  level  test  is  a written  test,  tell  tne  student  what  it 
is  for  and  let  him  complete  it.  You  may  want  to  time  this  test.  If  so, 
record  the  time.  If  the  entry  level  test  is  a performance  test,  l.nve 
an  expert  there  to  judge  the  performance  if  you  cannot  do  it.  Record 
the  student  responses  in  the  manner  planned  in  the  develop  data  recording 
system  step.  Score  the  test  immediately.  If  the  student  fails  it,  you 
probably  will  thank  him  and  send  him  back  to  his  unit.  Then,  start  at 
the  beginning  widi  a new  student. 

2.2.5  Administer  Pretest 

The  same  steps  of  explaining  v'lat  the  student  is  to  do,  yiving  him 
the  tests,  and  usinc,  the  data  recording  scheme,  are  used  here  on  the 
pretest  developed  in  Block  I I. 2.  Do  not  tutor. 

Score  the  test  immediately.  If  the  student  passes  it,  he  is  not  a 
good  individual  trial  subject.  You  cannot  say  that  the  student  learned 
from  the  lesson  if  he  already  knew  it.  Depending  on  what  learning 
objectives  he  lw.  mastered,  it  may  be  best  for  you  to  get  a new  student. 

2.2.6  Administer  and  Monitor  instructional  Materials 

For  an  individual  trial,  give  the  instructional  materials  to  one 
student.  Write  down  the  start  time.  Stay  with  him  through  the  whole 
lesson.  Record  each  question  he  asks,  matching  It  to  specific  places  in 
the  lesson.  Figur*  III. 27  Is  an  example  from  a trial  of  a slide/tape 


Lesson  Record 
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lesson.  Line  1 shows  tie  student's  response  to  the  question  In  slide  8. 
Line  2 shows  the  reminder  by  the  monitor  to  the  student  in  slide  13. 

Line  3 shows  a question  by  the  student  on  slide  20.  Line  4 Thews 
student  response  and  a time  statement.  Line  5 shows  written  conments  on 
an  observation  made  by  the  monltoi . Do  not  tuto*1  unless  the  student 
cannot  understand  the  directions.  Whenever  you  help,  document  it.  At 
the  e*,d,  write  down  the  finish  time. 

2.2. ' Administer  Posttest 

This  Is  rich  like  administering  the  pretest.  Do  not  help  the  student. 
Record  the  start  and  st'-p  times. 

2.2.8  Administer  Attitude  Measures 

Ask  the  questions  that  were  planned  and  record  the  responses.  AIst. 
add  any  questions  that  occurred  to  you  during  the  Instructional  materials 
trial.  Do  not  bias  the  questions.  If  you  point  cut  a slide  and  ask  the 
student  If  It.  would  be  better  with  two  arrows  instead  cf  one,  he  will 
probe'  ly  agree.  If  he  had  a problem  wit.i  a slide,  ask  him  how  it  could 
be  made  Nearer  or  more  helpful.  Ask  him  questions  about  his  proMems 
on  the  posttest.  More  exact  questions  can  be  askeo  if  you  can  sco'-e  the 
posttest  before  debriefl.ig.  If  this  takes  too  much  time,  go  ahead  end 
talk  tc  the  student  before  he  forgets  his  problems  or  ideas. 
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Sample  Test  Results 
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The  pretest  data  show  that  ^ and  0 are  really  "nalvet*  B and  C 
can  do  learning  objective  1.  Student  C can  also  do  learning  objective  2. 
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The  wlthlr-course  data  show  that  learning  objective  6 Is  a trouble 
area.  There  were  only  two  correct  responses  for  this  learnlt.g  objective 
on  the  wlthln-lesson  questions. 

Inn.  Participant  Participant  Participant  Participant  Total 

PbJ.  A 6 C 0 
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The  posttest  data  confirm  problem  on  Teaming  objective  6.  There 
was  no  aore  than  the  expected  error  on  any  other  learning  objective  on 
the  posttest.  You  should  now  look,  at  the  frame-by-frame  comments,  at 
the  sl^ttes  and  at  the  script. 
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The  following  types  of  problems  may  occur  In  interpreting  individual 
trial  data. 

You  are  making  decisions  baaed  on  very  small  samples \ four  to  six 
individuals.  The  powerful  statistics  usually  used  are  of  dubious  v * 
in  analyzing  these  results.  If  you  decided  that  when  80  percent  of  the 
leame»-s  respond  correctly  you  will  not  revise,  you  must  remenber  that 
any  chance  errors  will  distort  the  decision. 


A 

B 

C 

D 

E # Right 
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+ 

+ 
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If,  as  In  Result  1 above,  trainee  D lust  interest  or  made  a careless 
mistake  when  he  was  tested,  the  8056  criterion  that  you  might  have 
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The  situation  In  this  chart  Is: 

1.  For  one  learning  objective,  all  answers  were  correct. 

2.  Fo**  one  learning  objective,  a/1  answers  we*^  wrong. 

'J.  Errors  are  spread  across  all  students. 

4.  One  of  the  lowest  scoring  students  passed  a learning  objective 
that  the  highest  scoring  students  missed. 

Places  to  look  for  the  source  of  the  problem  are  listed  under 
"Action. “ The  100  percent  on  learning  objective  1 looks  like  you  did  a 
perfect  job.  This  Is  possible,  but  It  is  more  likely  that  the  strdents 
already  knew. the  material,  the  test  was  too  easy,  or  you  over-taught  the 
learning  objective.  The  latter  possibility  is  very  difficult  to  Identify. 
Interview  A and  ask  what  made  him  make  an  error  in  learning  objective  5. 
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The  post test  results  for  the  second  trial  after  revisions  looked 
like  this:  (Note  that  old  objective  1 and  Its  Instruction  were  dropped. 
The  supervisor  decided  that  It  wes  too  easy.  An  additional  learning 
objective,  6a,  was  added- -previously  overlooked  entry  behavior  needed 
for  learning  objective  6} 
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The  situation  in  this  chart  Is* 

1.  For  one  learning  objective,  all  answers  were  correct. 

2.  For  one  stedent,  all  answers  were  co-sect. 

3.  The  results  on  one  learning  objective  were  poorer  than 
on  the  first  trial. 

4.  All  other  results  were  an  improvement. 

The  poorer  performance  on  learning  objective  2 may  be  a result  of 
dropping  th:  instructional  material  related  to  learning  objective  1. 
Interview  D,  E,  and  F to  determine  what  made  them  make  errors  in  leaning 
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objective  4.  Interview  B and  C for  learning  objective;  6a  and  5. 

The  posttest  result*  for  the  third  trial  after  revisions  looked 
like  this:  (Note  that  o’d  learning  objective  1 and  some  of  Its  instruc 

tlon  were  replaced.) 
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The  situation  In  the  above  chart: 

1.  Errors  are  distributed  across  students  and  across  learning 
objectives. 

2.  Only  learning  objective  4 requires  further  revision. 

The  documentation  of  the  small  group  trial  should  Include  ?11  of 
the  results,  events,  reactions,  and  monitor's  comments.  An  example  of 
a report  is  presented  in  Appendix  A. 

2.3,3  Repeat  Cycle  or  Go  to  Group  Trials 

There  is  no  magic  number  of  individual 
trials.  They  require  a heavy  manpower  Input 
but  usually  contribute  a great  deal  of 
valuable  information.  From  three  to  five 
seems  to  be  the  usual  number.  Some  people 
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ir  ’ke  revisions  after  each  student.  This  gives  very  haavy  weight  to  each 
student  and  may  cause  vCtU  to  make  more  revisions  than  are  needed  or  to 
keep  tevising  on  the  smallest  possible  data  base. 

If  the  results  of  the  Individual  trials  were  good;  that  is,  jvndents 
came  close  to  the  goals,  and  you  received  as  much  information  as  y*u  felt 
was  needed  as  to  how  well  individuals  learned  the  materials,  go  ahead 
to  group  trials.  If  the  resrlts  were  poor  and  you  made  extensive  revisions, 
repeat  the  individual  this's  until  the  lesson  docs  what  It  is  supposed  to 
do.  Than  go  ahead  tu  group  trials. 


2.4  Develop  Plan  for  Group  Trials  i 1 

Croup  '.rials  can  be  of  any  size.  From  I — ; — I 

five  to  ten  is  considered  a small  group;  if  [ | 1 HBBBI 

more  than  25,  a large  group.  In  this  section  p~  j | h 

group  trials  will  first  be  treated  gene  ally,  | [ [ 1~] 

then  any  special  differences  betw  an  small 

f;id  large  groups  will  be  covered,  ^ 

You  may  conduct  several  small  grouy 
trials  or  none.  Several  small  groups  may  he 
a substitute  for  a large  group  end  you  may 

do  ono  or  several  large  group  trials.  It  all  depends  on  what  you  are 
working  toward,  how  much  time  resources  can  t»e  used,  and  the  problems 
encountered. 

much  of  what  was  prepared  for  individual  trials  can  be  used  o>- 
adapted  vor  the  group  trials,  Those  measures  that  were  already  covered 
in  the  Individual  trial  part  are  only  wuc'  id  in  this  section. 
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2,4.1  Set  Standards  an^  List,  Constraints 

You  may  have  some  preset  goals  that  you  set  and  others  that  were 
externally  imposed.  In  the  first  case  you  can  revise  tha«  tc  fit  reality. 

In  the  latter  case  you  may  have  little  control.  However,  keep  careful 
records  of  the  gods , procedures  and  needs,  for  whomever  controls  the 
standards. 

Standards  are  usually  stated  In  terms  of  what  proportion  or  per- 
ce'tane  cf  the  students  reached  crlterlo  . on  each  learning  objective. 

An  of.en  used  stundard  is  80  percent  (meaning  80  percent  of  the  students 
reached  the  predetermined  criterion).  Set  the  standards  in  terms  of  the 
alternative  resources  available  for  additional  Instruction.  Be  a little 
flexible.  There  is  nothing  sacred  about  the  set  criterion.  There  ir 
much  error  In  measurement.  There  are  sources  ol  error  both  in  the  measuring 
instrument  nd  in  the  learner's  perfonnar.ee . On  the  average,  a totally 
naive  learner  would  get  25  percent  correct  by  chance  on  a four-choice 
muHiple  choice  pretest.  But  on  any  one  test  he  might  score  50  percent 
or  0 percent.  The  same  guessing  factor  exists  in  a posttest.  Lver.  in 
a performance  test,  the  learner  may  make  *.  chance  error.  The  test  monitor 
can  mike  mistakes  scoring  the  performance.  When  you  say  you  want  80 
percent,  you  are  talking  about  the  population  When  you  take  a -ample 
it  is  unlikely  that  It  is  completely  representative  of  the  population; 
therefore,  different  samples  will  yield  different  scores  after  the  same 
instruction. 

If  the  standards  are  minimum  85  percent,  but  you  have  a performance 
test  and  25  students,  you  have  already  changed  the  standard.  Percents 
of  students  wiT1  be  in  multiples  of  4,  and  88  will  oe  the  first  possible 
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above  85,  and  you  have  forced  youtself  Into  an  88  percent  minimum.  Each 
trial  after  revision  usually  raises  scores,  numbers  to  reach  criterion, 
or  both.  But,  after  large  initial  gains,  each  increase  gets  harder  and 
more  expensive  to  reach.  It  Is  preferable  to  set  a ran<r  of  standards 
such  as  80,  give  or  take  five  points. 

However,  some  learning  objectives  are  totally  dependent  on  others. 

In  cases  where  the  terminal  learning  objective  cannot  be  performed  un- 
less any  one  or  mere  of  its  learning  objectives  are  mastered,  those 
learning  objectives  will  have  to  have  a 100  percent  crlterior. 

The  constraints  are  primarily  time  and  resources.  They  can  Involve 
equipment.  Do  not  plan  a large  group  trial  fo-  operation  of  heavy  equip- 
ment when  you  can  only  arrange  for  one  piece  o*  the  equipment  at  a time. 

In  such  cases,  you  will  have  to  try  the  materials  o..  students  serially. 
Trials  involve  manpower.  If  the  need  is  for  performance  testing,  you 
will  be  limited  by  the  number  of  monitors  who  are  available  or  can  be 
trained.  Constraints  can  be  environmental.  If  certain  weathe~  conditions, 
space,  or  geographic  locations,  are  required,  you  need  to  plan  within 
what  you  can  get.  There  also  may  be  deadlines  for  completions  to 
consider.  These  constraints  interact  to  present  very  restrictive  sets 
of  conditions.  Plan  to  work  within  them. 

2.4.2  Select  or  Develop  Data  Recording  System 

After  you  have  decided  what  data  is  needed,  prepare  a way  to  record 
it  while  it  is  being  collected  and  a way  to  display  it  so  it  can  be 
analyzed.  Since  you  are  likely  to  be  measuring  more  people  than  in  the 
individual  trials,  consider  machine  scorable  answer  sheets  if  they  can 
do  the  job.  An  example  of  a hand  recorded  data  summary  is  shown  in 
figure  111.29. 


Posttes1-  Data 
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Using  large  nimfrers  of  students  may  require  minimizing  the  amount  of 
data  collected.  Collect  the  data  In  a form  that  is  usable  with  the  minimum 
amount  of  conversion.  If  you  are  going  to  use  total  scores,  only  record 
them  rather  than  element  or  Item  scores.  But  do  not  threw  away  or  fail 
to  collect  da^a  you  will  need.  It  is  nard  to  get  students  back  after 
the  trial. 

2.1.3  Revise  Attitude  Measures 

If  you  are  going  to  make  any  decisions  based  on  nUitudes,  look  at 
the  attitude  measures  from  the  Individual  trials.  ‘.1111  they  be  sufficient? 
Do  they  require  revision?  rl'ist  new  ones  be  prepared? 

2.4,4.  Select  or  Develop  Data  Analysis  Plan 

How  are  you  going  to  use  the  numbers  to  make  decisions?  Individual 
comments,  masses  of  numbers,  etc.,  become  more  meaningful  when  they  ara 
organized.  (See  Figure  111.29  .)  The  R's  indicate  "right"  and  tho 
W's  indicate  "wrong."  The  W's  are  mote  numerous  than  the  R's,  but  it 
is  easier  to  think  about  the  column  and  row  summaries  and  the  percentages. 

If  you  have  many  test  elements  and/or  students,  conside"  using  a combination 
of  machine  scorable  answer  sheets  and  computer  data  analysis. 

Whether  you  or  the  computer  analyze  the  data,  the  technique  for 
summarizing  it  must  be  selected.  Do  you  want  averages?  You  can  compute 
means  and  standard  deviations.  Do  you  have  some  criteria  to  roach?  Do 
the  criteria  need  to  be  stated  by  objective  or  on  the  sum  of  tho  objectives? 


2.4.5  Select  and  Develop  Procedures  for  Grouo  Trial 

The  procedures  will  be  determined  by  the  lesson  itself,  the  number 
of  particif ants , and  the  data  needed.  In  a small  group  trial,  you 
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will  have  an  opportunity  to  get  individual  feedback  much  like  that  received 
In  an  Individual  trial.  In  a large  group  tr*  j1  the  students  will  be 
treated  more  like  those  in  a course  situation.  As  much  as  possible,  avoid 
interfering  with  the  lesson.  Anything  you  do,  even  the  measuring  instru- 
ments, Influences  the  outcome. 

2.4.6  Determine  Number  of  Participants  Needed 

When  there  are  members  of  the  target  audience  readily  available  and 
there  are.  no  resource  constraints,  use  an  arbitrary  number  such  as  20-30 
for  the  large  group  trial.  However,  there  are  often  some  limits  to  mem- 
bers of  the  target  audience  or  the  time  and  resources  available  to  conJuct 
trials.  There  is  a procedure  for  selecting  a minimum  sample  that  permits 
you  to  make  statistically  valid  decisions.  Your  minimum  s«...ple  will  vary 
depending  on  how  sure  you  need  to  be  of  your  decision.  This  procedure 
Is  particularly  useful  when  the  resources  Involved  In  validating  are 
scarce  and  testing  is  sequential,  one  or  a few  students  at  a time.  You 
rate  the  learning  objective  in  terms  of  its  consequences  of  inadequate 
performance,  performance  delay  tolerance,  availability  cf  trained  job 
holders  in  the  field,  learning  difficulty,  and  amount  of  practice  the 
trainee  will  have.  Based  on  the  score  on  these  criteria,  a chart  Is 
used  for  selecting  minimum  and  maximum  sample  sizes. 

First,  fill  out  the  learning  objective  rating  sheet  (Figure  III. 30) 

The  range  of  ratings  is  from  0 to  34. 
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2. 


3. 


What  are  the  consequences  of 
Inadequate  performance? 

a.  Very  serious  (10  points) 

b.  Serious  ( 5 points) 

c.  Average  ( 1 point) 

d.  Negligible  ( 0 points) 

Does  the  job  holder  have  time  to 
consult  references  or  seek  other 
help  when  required  to  perform  the 
task?  Is  immediate  action  required 
as,  for  example,  with  first  aid? 

a.  Immediate  action  required 
(10  points) 

b.  Some  degree  of  urgency  is  required 
but  job  holders  frequently  have 
time  to  seek  assistance. 

(5  points) 

c.  Job  holders  almost  always  have 
time  to  seek  assistance. 

(0  points) 

What,  is  the  availability  of  adequately 
trained  job  holders  In  the  field  to 
assist  in  cralning? 

a.  Few  available  (5  points) 

b.  Usually  available  (2  points) 

c.  Almost  always  available  (0  points) 

How  difficult  Is  the  learning  objec- 
tive to  le«m? 

a.  Very  difficult  (5  points) 

b.  Average  difficulty  (£  points) 

c.  Easy  to  learn  (0  points) 


FIGURE  1 1 1. 30:  Learning  Objective  Rating  Sheet 


l.e a m Im  Objective  Number 


Will  the  learning  objective  be  prac- 
ticed again  in  subsequent  lessors, 
or  is  the  lesson  the  only  choice 
to  Team  the  task? 

a.  This  lesson  is  the  only  instruction. 
(4  points) 

b.  Tne  learning  objective  is  practiced 
only  once  or  twice  In  subsequent 
les?ons.  (2  points) 

c.  The  learning  objective  will  be 
practiced  many  times  in  lemalning 
lessons.  (0  points) 


FIGURE  III. 30:  Learning  Objective  Rating  Sheet  (Continued) 


If  the  rating  Is: 

29  - 34,  use  Chart  1 (Figure  III. 31), 

21  - 28,  use  Ci, art  2 (Figure  III. 32), 

13  - 20,  use  Chart  3 (Figure  III. 33), 

7 - 12,  use  Chart  4 (Figure  III. 34),  or 

0 - w,  use  Chart  5 (Figure  III .35). 

Suppose  the  ratlnj  for  the  learning  objective  is  19,  therefore, 
Chart  3 (Figure  III. 33)  Is  used.  The  minimum  number  of  students  for  an 
accept  decision  is  7 and  for  a reject  decision  Is  4.  The  maximum  Is  46. 


The  area  on  the  graph  between  the 
diagonal  lines  is  the  "continue  testing 
area."  Above  the  lines  is  the  “reject 
instructional  materials"  or  no-go  area. 
The  area  below  the  lines  Is  the  "accept" 
or  go  area. 


Reject 


*£  2 Continue  Testing^-- 
«3  i 

•§  1 — ■"  Accept 

’ 0 M 2 3 4 5 6 
Number  of  Trials 


To  mark  the  charts,  place  an  X on  the  graph  for  each  trial.  The 
numbers  on  the  vertical  axis  are  the  number  of  students  who  failed  the 
objective.  The  numbers  on  the  horizontal  axis  are  the  numbe-  of  trials. 


If  the  first  trial  is  a failure,  piece  £ 

an  X over  the  1 colutm  of  the  umber  of  -E 

*VS 

Li. 

trials  and  hes.Je  tue  1 column  of  the  •£ 

failures.  & 
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N umbei  of  Trials 
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FIGURE  III. 34.  Chart  4 


FIGURE  III. 35:  Chart  5 


X 


If  tiie  first  tHa'i  .s  a go,  place  an 
X over  the  I column  of  the  number  of  trials 
and  beside  t* a 0 column  of  the  failures. 


Number  r f Trials 


Continue  .0  place  the  X‘s  horizontally  for  each  go  and  diagonally 
up  ft"  each  no-gn. 
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If  dll  th*  trials  are  gc‘s, 
the  chart  would  look  like  this 
and  the  7th  trial  is  in  tne 
accept  area  and  cesting  can  stop. 


1 2 ? 4 5 6 7 8 9 10  11 
Number  of  Tr.  .1$ 


If  all  the  tn-ls  are  no-go's, 
the  chart  would  lock  like  this  and 
tiie  4th  trial  "s  in  the  reject  area 
and  testing  can  stop. 


1 2 3 4 5 6 7 8 9 10  11 

Number  of  Trials 
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Test  Data 
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The  more  usual  result  woulc  be  a mixture  of  go’s  and  no-go's.  When 
there  are  3 no-gt  It  takes  21  trials  to  reach  the  accept  area. 


Sometimes  the  maximum  lumber 


and  down  to  the  accept  area. 
Whichever  is  closer  should  be 
chosen. 


Uuntx>r  of  Tri  - 


m 

2.4.7  Select  Participants 

Th®  participants  will  determine  the  lesson  outcomes  and  therefore 
the  revisions.  Be  sure  they  come  from  the  Intended  population. 

2.4.C  Train  the  Validators 

If  you  are  going  to  have  anyone  else  Involved  in  the  formative 
evaluation  process,  they  need  to  know  the  plans.  As  with  the  procedures 
used,  the  participants,  and  the  measuring  instruments,  the  vilidators 
will  influence  the  outcome.  If  the  validators  help  or  tutor  the  partici- 
pants and  It  Is  not  an  Intended  part  of  the  lesson,  you  will  have  a 
non-repl’ cable  and  maybe  undocumented  influence  on  the  outcome. 

2.5  Conduct  Group  Trial 

2.5.1  Conduct  Trial  and  Collect  Dat=» 
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2.5.2  Validation  of  Platform  Instruction 

One  of  the  more  commonly  used  approaches  to  Instruction  Is  the  lecture 
or  classroom  presentation.  Fach  service  hes  Its  own  specific  requirements 
for  the  development  of  platform  instruction,  ana  Block  III. 4 described 
procedures  for  the  development  of  new  classroom  presentations. 

Ir.  order  to  be  consistent  with  the  r.D  approach,  lectures,  platform 
instruction,  and  other  forms  of  classroom  presentations  must  be  subjected 
to  the  validation  process  if  they  are  to  be  an  important  part  of  training. 

There  are  two  kinds  of  classroom  presei. cations  which  must  be  consid- 
ered. The  first  is  the  existing  presentation  which  has  already  been 
prepared,  rehearsed  and,  perhaps,  used  for  several  c. asses.  For  this 
type  of  presentation  the  procedure  is  slightly  different  than  for  the 
development  of  new  platform  instruction. 

The  first  step  with  existing  platform  instruction  is  to  be  sure  the 
topics  to  be  covered  in  the  presentation  are  clearly  and  directly  related 
to  the  rh,9ctives  of  the  course.  There  is  a great  source  of  potential 
error  he»e.  Because  of  student  interest,  past  questions,  and  past  ex- 
perience of  the  instructor,  it  is  quite  possible  for  unrelated  and 
i rre1 evant  material  to  gradually  creep  into  the  presentation.  Therefore, 
the  development  of  a clear  relationship  between  the  objectives  and  the 
topics  or  presentations  needs  to  be  made  explicit. 

The  second  c .side. ation  ir  the  validation  of  existing  lectures  is 
an  examination  of  the  objectives  a/id  handouts  made  to  the  students. 

The  i.andouts  must  clearly  indicata  the  kind  of  performance  expected  from 
the  students  and  these  performances  must  clearly  match  the  objectives. 

Unco  it  has  been  determined  that  the  topics  and  presei. tations  are  directly 
related  to  the  objectives,  the  test  items  for  that  particular  presentation 
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must  he  related  to  these  objectives.  The  test  Items  should  be  developed 
according  to  the  procedures  outlined  In  Block  l’.2.  They  should  bl 
limited  to  a single  presentation. 

Each  presentation  should  be  evaluated  separately  rather  than  making 
several  presentations  and  evaluating  them  at  the  end  of  a week  or  longer 
period.  A relatively  detailed  test  from  Block  II. 2 Is  required  to 
evaluate  student  performance  within  a given  presentation. 

Another  Important  consideration  Is  deciding  whether  the  test  should 
be  administered  Immediately  following  the  presrniatlon  or  presented 
after  Hie  students  have  studied  any  materials  specified  in  the  ’ecture. 

It  Is  quite  conrnn  to  make  assignments  to  gc  along  with  a presentation 
and  It  is  the  aggregate  assignment  and  presentation  that  Is  to  be  evaluated. 
However,  for  validation  purposes,  the  students  should  be  tested  Immed lately 
following  tlr  presentation  on  those  items  specific  to  the  presentation, 
and  tested  again  after  they  have  had  time  to  study,  on  those  Items  which 
are  based  on  the  outside  activities. 

One  purpose  of  tie  careful  attention  to  learning  objectives  and  test 
Items  Is  to  segregate  the  l-aming  due  to  the  presentation  and  that  .lie 
to  the  nu -side  activity.  It  may  “se  that  if  errors  are  consistently  made 
on  some  1 toms , there  is  a difficulty  with  the  outside  materials,  or  It. 
may  be  that  something  in  the  presentation  is  confusing  to  the  students. 
Detailed  testing  will  ordinar. ly  reveal  the  source  of  the  problem  and 
the  required  revisions  cae  be  mada. 

When  4.he  test  results  are  analyzed  for  existing  platform  instruction. 

It  may  become  clear  that  the  presentation  did  not  provide  sufficient  time 
or  examples  or  clarity  on  one  or  more  topics.  By  changing  the  amount  of 


331 


fu«l 


I! 


tine  devoted  to  a given  topic  or  by  changing  the  kinds  of  rules  or 
examples  or  non-exampies  presented,  the  Instructor  can  often  make  drama- 
tic Improvements  In  the  amount  the  studen.s  learn.  The  same  rules  for 
analyses  of  the  learning  objectives  besc.lbed  elsewhere  In  this  block 
should  aoply  to  the  classroom  presentation  as  well. 

For  new  presentations,  the  material  can  be  organized  according  to 
the  Intended  method  of  testing.  That  Is,  topics  within  lectures  can  be 
isolated  and  clearly  related  to  the  teaming  objectives  and  the  tost 
Items  for  those  objectives.  The  presentations  shc:tld  be  tried  out, 
wherever  possible,  on  members  nf  the  target  population  before  they  are 
actually  used  In  a regular  classroom  setting.  In  thost  Instances  where 
It  Is  not  possible  to  try  out  the  materials  ahead  of  time,  a careful 
record,  usually  an  audio  tape  plus  a copy  of  any  chalkboard  displays  or 
otiier  training  aids  used  with  the  lecture,  should  be  kept  of  each  pre- 
sentation. This  will  permit  thorough  review  of  presentations  and, 
through  time,  the  original  presentations  can  be  revised  to  eliminate 
any  problems. 

2.5.3  Analyze  and  Consolidate  Data 


Tills  Is  more  complicated  than  after  the  Individual  trials,  but  If 
the  recording  and  analysis  plans  were  good,  they  should  provide  the 
required  data  base.  If  they  do  not,  revise  both  plans  based  on  the 
data  obtained. 
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Based  on  analysis  of  trial  aata, 
nake  necessary  revisions  to  tue  program. 

Remember  that  more  than  lust  the  '•nstruc- 
tlonal  materials  may  have  to  be  revised. 

You  may  have  tn  make  changes  to  pretests , 
management  plan,  delivery  system,  or  posttest, 

O 

A subject  matter  expert  CSMT'  will  be 
needed  as  the  technical  advisor  on  revisions. 

If  at  all  possible,  use  an  SHE  who  Is 

thoroughly  familiar  with  the  current  field  use  of  the  task  being  taught 
rather  than  one  who  has  taught  the  task  In  a formal  school  environment. 

He  will  be  more  conscious  of  job  requirements  and  be  less  tied  to  the 
way  things  have  always  been  done  In  the  school. 

As  was  true  following  the  Individual  trials  , there  are  no  firm  -ules 
here  for  making  revision  decisions.  General  guidelines  were  presented 
earlier  In  the  block.  Following  Is  another  discussion  that  provides 
guidelines  more  specific  to  making  revision  decisions  frl  lowing  group 
trials. 

Suppose  you  have  just  completed  a formative  evaluation  on  30  students. 


The  data  looks  like  this; 


l?5‘ 
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What  does  the  data  mean:' 


9* 

j.  Item What  Does  It  Mean? Whit  Can  You  Do? 


1 


a.  Questions  have  give-away  a.  Revrlte  the  question, 
answers . 

b.  Everyone  knows  It  already.  b.  Drop  the  Item  and  the 

matching  learning  material. 


i 

» 

\ 


l 


2 2/3  failed  It  on  ti.e  pretest,  Look  at  the  4 error  re- 

1/3  W/I  course,  and  only  4 spouses  and  see  If  they  all 
failed  on  the  posttest.  made  the  same  error--1f  so, 

add  only  enough  Information 
to  prevent  the  error.  If 
they  made  different  errors, 
probably  do  nothing. 


3 a.  801  lacked  entry  behavior.  a.  Reanalyze  entry  behaviors; 

add  the  necessary  pre- 
requisites to  the  lesson. 


*■  *»! 


2/3  failed  all  three  tests. 


You  haven't  hanged  behavior. 
Go  back  to  the  learning  ob- 
jective, look  at  the  leaml  lg 
objective,  learning  material, 
and  test  Item  for  mat  Jl. 
Reanalyze  the  ta.'k  for  some 
other  en^.-y  level  behaviors 
or  additional  learning 
objectives . 


Only  1/5  failed  all  three 
times. 


1/3  failed  oretest,  1/5  on 
W/I  course,  but  1/2  on 
posttest. 


You  have  80%  on  the  pretest, 
but  you  really  didn't  Im- 
prove scores  enough  to  think 
they  have  learned  anything. 
Are  the  errors  made  by  the 
same  people  on  all  three 
tests?  If  so,  check  as  for 
item  4.  If  not,  perhaps  the 
item  and  the  learning  material 
should  be  dropped. 


Look  at  feedback  for  Item  at 
W/l  course  point  and  subservient 
to  W/I  course  Item  to  find 
something  that  has  mislead 
the  students,  or,  you  nay 
need  a review  befoie  the  enc 
of  this  part  of  the  learning 
objective. 
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Lng. 

Ob j , Item 


What  iX)es  It  Hean? 


What  Can  You  Do? 


Less  than  or  equal  to  1/5  on 
all  tit*  3e. 


You  have  Improved  scores 
but  you  are  probably  wasting 
time  to  even  have  the  learn- 
ing objective.  Check  to  see 
If  you  can  omit  the  Item  and 
the  material,  or  decrease  the 
material  to  a reminder  and 
possibly  omit  the  Item  if 
other  learning  objectives 
are  dependent  on  tins 
learning  objective. 


2/3  failed  pretest,  1/2 
failed  W/I  course,  almost 
none  failed  posttest. 


The  final  result  was  excel- 
lent, but  some  of  what  was 
done  after  the  w/i  course 
test,  should  be  done  before 
it,  unless  It  was  the  error 
correction  that  they  learned 
i rom. 


1/2  failed  pretest,  1/2 
failed  W/I,  1/6  failed 
posttest. 


The  learning  materials  prior 
to  the  W/I  course  test  were 
noc  effective.  They  iould 
be  dropped  if  the  errors  are 
mode  by  the  same  people  on 
W/I  course  test  and  posttest. 
If  not,  incorporate  whai  came 
after  W/I  test  befe'e  it,. 


2/3  failed  pretest,  1/10 
fared  W/I,  1/5  failed 
posttest. 


looks  f'.actly  as  it  should. 
Peihaps  a mir'mu.ti  of  review 
before  the  posttest  based 
on  the  posttest  errors  would 
keep  down  the  post  test  errors, 
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It  may  be  necessary  to  repeat  the  revision  cycle,  If  the  students 
did  not  reach  criterion,  you  need  tc  repeat  the  revision  cycle. 

When  the  revisions  are  completed,  and  you  have  again  tried  them 
out  and  made  sure  they  work,  It  is  time  to  try  the  Instructional 
materials  with  real  world  Instructors  and  the  astern  r.ianagement  plan. 


3.0  OUTPUTS 


Tho  outputs  of  this  block  should  consist  of  a summary  statement  of 
pertinent  factors  in  each  validation  trial  {see  example)  As  a minimum, 
this  statement  should  contain: 

1.  Participant  background  information 

2.  Instructor  qualifications 

3.  Data  and  place  of  trial 

4.  Learning  objectives 

6.  Outline  of  data  recording  plan 

6.  Entry  t^sts  used 

7.  Pretests  used 

8.  within  course  tests  used 

9.  Posttests  used 

10.  Plan  for  presenting  learning  materials 

11.  Any  deviations  from  instructional  plan  or  data  recording  plan 

12.  All  test  data  in  consolidated  or  summarized  form 


1 


1 
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23.  RecaBauktlons  for  revisions  af*^r  each  trio! 

14.  Rationale  for  revision  recorrmendations 

15.  Summary  of  revisions  actually  made 

16.  Rationale  for  any  differences  between  revision  recommer 
do t 1 uns  and  actual  revisions 


EXAMPLE 

Sample  documentation  for  a single  validation  trial  on 
materials  designed  to  teach  maintenance  of  the  OH-58 
helicopter's  power  train  system: 

1.  Participant  Background:  26  students  who  were  to  enroll 
In  the  OH-58  Helicopter  resident  school  the  following 
week. 

2.  Instructor  Qualifications:  The  Instructor  taught  OH- 58 
helicopter  repair  at  the  resident  school  .or  3 years  and 
was  recommended  by  the  school . 

3.  Data  and  Place:  Fort  Dix,  New  Jersey.  August  1,  1975. 

4.  Learning  Objectives: 

a.  In  a Maintenance  work  area  using  an  OH-58  helicopter, 
Techri.cal  Manual  55-3520-228 -25,  general  mechanics  tool 
kit,  maintenance  platform,  and  DA  Form  2408-13,  the 
student  will  troubleshoot  the  power  train  system  in 
accordance  with  Technical  Man’ al  55-1520-228-20. 

b.  In  a maintenance  work  area  using  an  OH-58  helicopter. 
Technical  Manual  55-1520-228-20,  general  mechanics  tool 
kit,  maintenance  platform,  and  DA  Form  2408-13,  the 
student  will  perform  a maintenance  operational  check  in 
accordance  with  Technical  Manual  55-1520-228-20. 

5.  Data  Recording  Plan:  Data  on  each  student  will  Include: 

a.  Background  Information 

b.  Attitude  questionnaire  results 

c.  Entry  level  test  results 

d.  Pretest  results 

e.  Within-course  test  results 

f.  Posttest  results 

g.  Validator's  comments  to  student 

h.  Student  question.,  and  remarks 

i.  interview  results 

j.  Time  spent  oi>  lessons  and  sub-lessons 
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Entry  Test  Used: 

a.  Select  the  appropriate  tool  for  each  fastener. 

b.  Name  each  tool  In  the  general  mechanics  tool  kit. 

c.  Explain  the  use  of  each  tool  In  the  general 
mechanics  tool  kit. 

Pretest.  Used: 

a.  r amove  tall  rotor  nub 

b.  Remove  tall  rotor  gear  box. 

c.  Remove  tall  rotor  drive  shaft. 

Wlthin-course  test  used:  (Same  Items  as  pretest,  but  with 

reduced  standard  of  performance.) 

Posttest  Used:  Same  Items  as  pretest. 

Presentation  of  Instrjctlona".  Materials:  The  Instructor 
demonstrate.,  ail  the  maintenance  functions  for  the  power 
train  system  while  explaining  nls  activities.  The  Instruc- 
tional materials  were  the  script  and  «ct1vity  ..cquence 
outline  which  he  repeated  precisely. 

Deviations  from  Plan:  The  Instructor  answered  several 
spontaneous  student  Questions.  The  questions  and 
responses  were  recorded  on  videotape. 

Consolidated  Test  Data: 

a.  Entry  level  test  - X * 7 9 

b.  Pretest  results  - 3.6 

c.  Posttest  results  - X - 18.7 

Reconur ^ndatlons  for  Revision: 

a.  Delete  Introductory  "yeneral  remarks." 

b.  Provide  instructor  with  replicate  tool  kit. 

c.  Delete  item  § 7 from  pre-test,  within-course  test,  and 
posttest. 

d.  Evaluate  item  #12  and  related  inst*'uct1on. 

e.  Evaluate  student  request  for  individualization  of 
"remove  main  rotor  swashplate." 

Rationale  for  Revisions: 

a.  Remarks  do  not  relate  to  specific  objective. 

b.  Instructor's  tool  kit  was  missing  a spanner  v/rtreh. 

c.  Item  too  easy.  Everyone  passed  U each  time. 

d.  Poor  performance. 


c 
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16.  Summary  of  Revisions  Actually  Mads: 

a.  Introductory  "general  remarks1'  deleted. 

b.  Instructor's  equipment  checklist  developed. 

c.  Item  #7  deleted. 

16.  Rationale  for  Differences  between  Pecommeridatio  .s  and 
Actual  Revisions: 

a.  voor  performance  on  Item  #12  may  Indicate  either  a 
poor  Item  or  pocr  instruction,  but  this  data  Is  Incon- 
clusive. The  Instruction  nJattny  to  the  Item  cs  well 
as  the  Kem  Itself  will  be  retained  as  Is  and  used 
again  >n  the  next  tryout. 

b.  ThLugn  most  students  requested  individualization  of 
the  instruction,  “remove  mein  .otor  swashplate,"  this 
will  not  be  done.  Student  test  performance  was  not 
adequate  and  it  is  not  cost-effective  to  individualize 
one  small  segment  of  a large  group  presentation. 

17.  Additional  Comments;  Though  the  stude.it..  had  been 
selected  to  attend  OH-58  helicopter  schiol,  they  were 
not  ari  idej  sample.  Their  background  data  indicated 
a greater  interest  In  mechanics  than  most  incoming 
OH-58  helicopter  school  students.  Their  scores  may 
be  unusually  high  as  a result. 
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APPENDIX  A 


EXAMPLE  OF  SMALL  GROUP  TRIAL  REPORT 

Administration  of  Test 

A.  Administrative 

1.  Background  data  sheet  numbered  1 through  4 

2.  Tablets  of  paper 

3.  Pencils 

4.  Cassette  recorder  with  one  tape 

5.  Stop  watch 

B.  Hardware 

1.  Two  study  carrels  equipped  with  Norelco  cassette  tape 
pi  vers 

2.  Two  M2C3's 

3.  Two  cleaning  rods 

4.  Two  cans  of  oil  and  cleaning  patches 

C.  Courseware 

1.  Pre-post  test. 

2.  Four  notebooks  containing  the  18C  story  board  frames  of 
the  program 

3.  Four  tapes  of  the  M203  script 

D.  Breakdown  of  how  oue-ort-one  formative  evcluatior.-  was  conducted 

1.  Briefing 

a.  Explained  briefly  what  TEC  is 

b.  Explained  soldier's  role  as  tester  of  materials 

2.  Had  the  four  test  soldiers  fill  out  background  data  forms 
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3.  Assigned  control  numbers 

4.  Started  first  soldi ei  on  pretest 

5.  Gave  scldler  notebook  1 of  story  board,  cassette  tape  and 
M2Q3 

6.  Subject  expert  monitored  soldier 

7.  Administered  posttest 

8.  Debriefed  soldiers 
E.  Special  problems 

1.  Three  subjects  had  hangovers.  One  war  actively  111. 

2.  Photographers  and  observers  made  soldiers  very  nervous. 

3.  Tapes  were  not  timed  to  soldiers'  pace. 

4.  M203's  arrived  late  and  were  very  oily. 

5.  There  were  no  dimmy  40mm  grenades. 

II.  Test  Results 

A,  Background  Information 


0. 

Duty  Assignment 

Armor 

Tanker 

Gunner 

Tank 

Crewman 

i . 

Rank 

E-3(Pfc) 

E-3(Pfc) 

E-3(Pfc) 

E-b(Sgt) 

2. 

Date  entered  service 

11/29/71 

11/29/71 

9/29/71 

7/H/d9 

3. 

Time  lit  grade 

14  mos . 

-- 

14  mos. 

36  mos. 

4. 

Date  completed  BCT 

2/18/72 

2/29/72 

12/3/71 

9/18/69 

5. 

Date  completed  AIT 

5/  m 

-- 

3/23/71 

10/20/69 

6, 

Education  level 

ii 

10 

10 

GED 

7. 

Primary  MOS 

-- 

11E10 

1 1 E10 

I1E40 

8. 

Secondary  MOS 

— 

-- 

— 

11B40 

} 

i 


i 

I 

s 

) 

j 

t 


J 
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11B40 


9.  Age 

10.  Prior  training  with 
M203 


.J-  i» 

r 4 = 

=«#  - {■== 

Armor 

Tanker 

Gunner 

Tank 

Crewman 

22 

20 

19 

21 

none 

none 

none 

none 

Number 


3.  Pre-post  Test  (possible  50  points) 


Soldier 

Pretest 

Posttest 

% 

Change 

Actual  gain 
Possible  gain 

1 

1 

2 

05 

70 

33 

33  = .69 

j 

m 

« 

.* 

f 

2 

0 

33 

66 

33 

33  = .63 

1 

50 

1 

1 

3 

6 

42 

84 

36 

36  = .82 

J 

44 

7 

4 

10 

37 

74 

27 

27  « .67 
4J 

i 

i 

I 

1 

X 

4.2 

38 

76 

4 

C.  Time  in  Minutes 


Soldier 

Pretest 

Within  Program 

Posttest 

AM/ PM 

1 

11 

97 

24 

AM 

2 

20 

92 

16 

PM 

3 

35 

127 

20 

AM 

4 

25 

70 

25 

PM 

D.  Reaction  to  Program 
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1.  The  overall  reaction  was  favorable.  The  soldiers  did  not 
have  prior  experience  with  the  M203  and  liked  Kindling  It. 

5 1 . The  debriefing  Interview  indicated  a positive  Attitude.  They 
all  said  that  the  audio  was  clear,  the  pictures  mostly  helpful, 
they  were  not  bored,  and  they  were  never  lost.  However,  one 
said  there  were  too  1jw  questions,  one  said  too  many,  and 
one  said  just  the  right  nunber. 

3.  No  really  useful  remarks  were  made  about  Improvtng  the  course. 
One  suggested  using  more  questions. 


E.  Observers'  Comments 

The  program  had  been  edited  several  times  by  subject  experts. 
The  same  subject  experts  were  also  observers 
Frame  Comment 

31  picture  upside  down 

32  need  more  time 


H 


53-55 


soldier  missed  barrel  extension 

include  picture  of  wespon 

need  more  time  and  better  explanation 

missed  guide,  stop,  latch,  true* 

m,re  time,  better  differentiation  of  sights 

more  time  - error  of  screw 


h 1 


more  time  - error  of  screw 

confusing  because  weapon  in  picture  is  disassembled, 
needed  review 


72-73 


lost,  couldn't  clear  M203  or  Ml 6A1 


76-89 

90-95 


change  one  minute  method  to  method  1 
diff.culty  getting  handguard  off 
102  visual  not  clear 

113  directions  confusing 

114  talked  through  method  2 

115  didn't  know  conditions 

117  picture  and  audio  don't  represent  combat 

130-132  confusion  of  LSA  and  LAW 
136  confusion  - asking  about  temperature  range 

148  review  care  under  different  weather 

General  Comnents 

1.  Make  differences  between  two  procedures  more  pronounced. 

2.  Have  student  demonstrate  clearing  rather  than  write  about  it 

3.  Clarify  objectives.  Make  sure  he  finds  parts  on  M203. 

4.  Need  clarification  on  why  M203  is  disassenfcled. 

5.  Need  clarification  on  why  only  2 parts  are  taken  off  in  one 
minute  method. 


F.  All  errors  and  comments  will  be  considered  in  the  rewriting. 
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PHASE  III 


Block  IUA 


Aagard,  J.  A.,  & Braby,  R.  Learning  guideline.;  and  .Jgoritlws  for 
twelve  types  of  training  objectives'  (TAEG  Report  No.  23). 
Orlando,  Fla". : Department  of  the  Navy,  Training  Analysis  and 
Evali  ation  Group,  in  press. 


Learning  algorithms  hcve  been  deve’oped  for  fundamentally  different 
types  of  training  objectives  representing  military  tasks.  They 
are  based,  in  part,  on  an  earlie»  Navy  study  on  conroon  Navy  tasks 
and  are  designed  so  that  (1)  a wide  range  of  tasks  can  be  grouped 
into  a small  number  of  categories,  (2)  all  the  training  objectives 
In  one  category  can  be  achieved  by  using  a single  learning  algorithm, 
and  (3)  each  category  of  training  objectives  requires  a different 
learning  algorithm;  i.e. , fundamentally  different  from  the  training 
strategies  required  by  other  classes  of  training  objectives. 


Braby,  p.,  Henry,  J.  M. , Parrish,  W.  F.,  Jr.,  & Swope,  W.  M.  A technique 
for  choosing  cost-effective  instructional  delivery  systems  fTAEG 
Report  No.  16).  Orlando,  Fla.:  department  of  the  Navy,  Training 
Analysis  and  Evaluation  Group,  Aptii  1975. 


The  process  of  selecting  instructional  delivery  systems  is  formally 
Initiated  when  the  training  objectives  for  a proposed  training  system 
have  been  received.  A set  of  training  objectives  are  an  input  to 
the  TECEP,  a process  for  selecting  cost-efficient  instructional  delivery 
systems.  Starting  with  this  set  of  objectives  a sequence  of  steps 
is  accomplished  for  deriving  appropriate  learning  strategies,  identifying 
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Ins'. -motional  delivery  systems  capable  of  supporting  these  strate- 
gies, and  determining  costs  associate  with  these  delivery  systems. 

The  output  of  this  cfvor*  Is  a description  of  an  optimum  Instruc- 
tional delivery  systun  for  accompli s'llng  the  training  objectives. 

Carroll,  J.  A model  of  school  learning.  Teachers  Colleqe  Record,  I 

1963,  64,  723-733.  ~ 

This  conceptual  model  suggests,  at  a suptrurdinate  level,  every 
element  required  for  an  Individual's  success  or  failure.  The 

I 

article  presents  factors  which  are  conceived  as  being  determinants  j 

of  the  times  needed  or  actually  spent  In  learning  a task  and  j 

the  way  in  which  these  factors  interact  to  result  in  various  de-  j 

grees  of  successful  learning.  1 

Homme,  l.,  Csanyi,  A.  P.,  Gonzales,  M.  A.,  & Rechs,  J.  R.  Sow  to  use  con- 

tinqencv  contracting  In  the  classroom.  Champaign,  111.:  Research  ! 

Press,  1971.  j 

The  authors  of  this  book  present  contingency  contracting  as  one  | 

i approach  to  the  use  of  reinforcement  principles  to  motivate  better  I 

; learning.  The  procedures  outlined  in  this  book  are  based  on  arrang- 

ing the  conditions  so  that  the  learner  gets  to  do  something  he  wants 
to  do  following  something  the  instructor  wants  him  to  do. 

Klaus,  D.  J.  Students  as  teaching  resources:  A survey  of  teac! ing  models 
using  non-professionalT  (peer  tutoring)  (AIR  40900-1 0/73- FR) . 

Pittsburgh,  Pa". : American  Institutes  for  Research,  October  1973. 

This  prelimirrry  survey  was  designed  to  explore  the  possible  use  of 
stud  nts  as  teaching  resources  in  the  developing  countries.  A 
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substantial  number  of  departs  and  descriptions  of  projects  already 
conducted  In  the  United  States,  and  a few  a fried  out  overseas,  sug- 
gest that  students  represent  a significantly  under-util i2eu  resource 
and  yet  could  be  mobilized  to  help  other  children  learn.  Four 
general  models  of  peer  tutoring  are  describc-i.  A research  design, 
emphasizing  effective  Instruction  in  over-*rowd°d  classrooms,  was 
reported  as  part  of  a five-year  schedule  for  innovative  programs  in 
developing  countries. 

Wcingarten,  K. , hdngerland,  J.  E.,  & Brennan,  M.  F.  Development  and 
implementation  of  a quality-assured,  peer-instructional  model 
"(liiiiiiRROj- Technical  Report  72-35).  Alexandria,  Va.:  Human  Resources 

Research  Organization,  November  1912. 

This  model  describes  a quality-assured,  peer- instructional  system 
incorporating  six  principles  essentia1  to  effective  instruction,  and 
accomodating  practical  constraints  having  to  do  with  cost  a.id  the 
ease  of  implementation.  Data  was  collected  comparing  the  conventional 
and  APSTRAT  systems  in  the  course  of  the  pilot  study  at  Ft.  Ord. 

From  this  pilot  study,  the  data  indicated  that  the  primary  objectives 
of  the  -rogram  were  attained--substantial  gain  in  proficiency  for  men 
of  all  aptitudes,  and  reducti-n  of  academic  attrition  and  recycles. 
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Brcby,  R.,  Henry,  0.  M.t  Parrish,  W.  F.,  Or.,  & Swope,  W.  M.  A tech- 
nique fcr  choosing  cost- effective  Instructional  delivery  systems 
(TAEG  Report  No  16).  OrYinda,  Fla.l  department  of  the  Navy, 
Training  Analysis  and  Evaluation  Group,  April  1975. 


The  purpose  of  this  r port  is  to  make  available  to  training  special- 
ists a procedure  fo»  choosing  instructional  delivery  systems 
appropriate  to  various  types  of  military  training.  The  TECEP  tech- 
nique serves  as  a performance  aid  for  the  training  specialist  to  use 
in  defining  appropriate  training  strategies  for  training  objectives, 
choosing  instructional  delivery  systems  capable  of  carrying  out  the 
training  stretegies,  and  identifying  the  relative  cost  of  these 
alternatives.  Through  the  use  of  this  procedure,  training  special- 
ists choose  the  cost-effective  instructional  delivery  system  over 
its  competitors. 


REFERENCES 


PHASE  III 


Block  III. 3 


Deterline,  W.  A.,  & Lenn,  P.  0.  Coordinated  instructional  systems 
training:  A self-study  course  for  teachers.  PaTFTTto . Calif. : 
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considered  self-instructional. 


Dale,  Edgar.  Audiovisual  methods  in  teaching.  Hinsfale,  111,:  The 

Dry den  Press,  1§$9. 

Audiovisual  materials  compose  an  integral  part  of  any  training 
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to  correspondence  courses,  how  to  prepare  STEPs,  and  how  to  convert 
mediated  materials  to  print  materials. 
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Deterline,  W.  A.,  & Lena,  P.  D.  Coordinated  instructional  ystems  train,- 
Irn:  A self-study  course  ror  teachers.  Palo  Alto.  Cal*t~  ^ound 
Ec jca'Oon , TncTT  1972! 

This  course  Is  about  the  des  gn  of  instruction,  ?mphas1zing  pro- 
cedures for  making  Instruction  as  effective  as  possible  and  includ- 
ing procedures  for  Individualizing  instruction.  The  purpose  of  the 
course  is  co  help  you  l2arn  a set  of  skills  and  techniques  that  will 
serve  you  as  you  design,  develop,  and  Implement  instruction  for  your 
students.  It  works  as  a self-study  course,  individualized  and  with 
specified  learning  outcomes.  This  is  not  a "read  about"  course;  it 
is  a “workshop"  oi  “laboratory"  type  of  course,  involving  actual 
design  and  development  of  lessons  and  testing  the  lessons'  "nth  "real 
live"  students,  not  j ct  to  find  out  ho;/  well  students  learn,  hut  to 
find  how  ell  the  lessons  teach. 

Espich,  J.  , & Killians,  B.  Developing  programmed  instructional  ma- 
terials. Beltnon'-,  California!  F^ron  .’roll sliers  , 1967. 

Many  individualized  learning  program*  employ  programmer  instruction 
In  some  fashion,  to  deliver  all  or  part  of  the  Instruction.  This 
brief  book  contains  an  explanation  and  practice  frai'ts  on  the  pre- 
paration, cot's  1/ action,  and  testing  of  programmed  instruction 
sequences. 
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Frieson,  Paul  A.  Designing  instruction.  Santa  Monica,  Cilif.:  Miller 
Publishing  Co.,  tS/3. 

Instructional  technology  offers  a systematic  and  logical  means  for 
the  design  of  instruction.  Programmed  instruction,  fr example,  is 
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very  heavily  based  In  the  concepts,  techniques,  and  principles  of 
instructional  technology.  This  manual  describes  a systems  method 
of  instructional  designed  material  based  on  an  application  of  pro- 
gramed instruction. 


Joyce.  R.  ?.,  Chenzr^f,  A.  P.,  Mulligan,  J.  L.,  ft  Mallory,  W.  J.  Ful ly 
procedural i zed  job  performance  a ids:  Handbook  for  JPA  developers. 

Brooks  Air  Force  Base,  Texas:  Air  Force  Systems  Command,  Human 

Resources  Laboratory,  December  1975. 


Since  relatively  few  fully  proceduralized  JPAs  have  been  developed, 
few  people  have  been  trained  in  the  techiiolngy.  This  handbook  de- 
scribes a method  tc  increase  this  capacity  and  to  provide  Air  Force 
personnel  with  the  knowledge  necessary  to  effectively  monitor  JPA 
procurement.  Also,  the  need  for  coordination  between  JPA  content 
and  job-oriented  training  content  is  discussed.  It  is  increasingly 
realized  that  such  coordination  can  provide  superior  on-job  performance, 
and  can  be  more  cost-effective. 


(lager,  R.  F.,  ft  Pipe,  P Analyzing  performance  problems.  Belmont,  Calif.: 
Fearon  Publishers,  December  1975. 

Some  performance  problems  can  be  eas’ly  sol.ee,  especially  those  re- 
lating to  simple  skill  deficiencies.  Other  problems  can  u»e  elimi- 
nated by  applying  prir.cip1es  of  humin  behavior.  This  book  is  about 
problems  that  arise  wh^n  a job  is  not.  being  done  properly  and  ex- 
plains a procedure  for  analyzing  such  problems. 
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The  Ministry  of  Defense,  Her  Majesty's  Royal  Navy  (Producer).  . Programmed 
Instruction.  London:  Stewart  Films,  Ltd.,  1970.  (Film) 

This  film  describes  th2  underlying  concepts  of  programed  Instruc- 
tion. It  serves  as  a very  effective  Introduction  to  these  concepts, 
especial’.;-  in  describing  behavioral  objectives. 

Zettl,  H.  Televised  production  handbook.  Belmont,  California:  Wads- 
worth Pub) ishing  Co. „ 1968! 

Before  television  programs  can  be  produced  to  communicate  an  in- 
structional message  it  is  necessary  to  become  familiar  with  the 
technology  of  the  medium.  This  text  achieves  just  this  purpose 
through  a concise  description  of  the  technical  equipment,  perfor- 
mance, and  production  aspects  of  television  technology. 
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Deterllne,  W.  A. , & Lenn,  P.  D Coordinated  Instructional  systems 
training:  A self-study  course  for  teachers,  falo  Alto,  Calif  : 

Sound  Education,  Inc.,  1972. 

The  forma  Live  evaluation  or  process  jf  validating  Instruction  is 
a key  component  of  a coordinated  instructional  system.  The 
CISTRAIN  model* based  on  systematic  course  development,  requires 
the  Instructional  designer  to  validate  all  instruction  to  ensure 
that  the  learning  objectives  are  realized. 

Mager,  R.  L.  Measuring  instructional  intent.  Palo  Alto,  California: 

Fearon  PubVi  slier S.19T-C 

In  order  to  find  out  if  the  developed  instruction  is  successful, 
validation  of  instructional  materials  is  necessary  to  determine  if 
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one  has  succeeded  as  intended.  According  to  Mager,  the  measure-  ; 

ment  of  this  success  is  accomplished  through  the  development  of  sit-  j 

uations  test  items  which  reflect  the  carefully  written  objective. 

This  book  presents  information  on  how  to  develop  basic  tools  with 
which  to  measure  instructional  intent  and  how  to  recognize  i tarns 
which  can  determine  whether  a student  has  achieved  the  instructional 
objective. 
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Popham,  W.  J.  Evaluating  instruction.  Englewood  Cliffs,  N.J.: 
Prentice- HaTSTTncT  , 1973. 

Renewed  interest  In  e aluatlng  classroom  instruction  is  evident 
at  all  levels  of  educational  endeavor.  This  self-instructional 
book  provides  the  reader  with  a basic  working  knowledge  of 
measurement,  test  theory, and  evaluation. 


Swezey,  R.  W. , & Pearlstein,  R.  B.  Developing  criterion-referenced 
tests.  Reston,  Va.:  Applied  Science  Associated,  1974. 


The  validation  process  (formative  evaluation)  tries  out  instruction 
on  a smi’l  sample  of  target  population  for  the  purpose  of  ascertain- 
ing if  the  instruction  meets  the  learning  objective's.  When  properly 
followed, the  validation  process  insures  better,  quality  instruction. 
Specifically,  this  means  that  all  trainees  will  achieve  the  objec- 
tives after  instruction. 
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ACRONYMS 


AFS  - Air  Force  Speciality 

AR  - Array  Regulations 

CMI  - Computer  Managed  Instruction 

CRT  - Criterion  Referenced  Test 

CODAP  - Comprehensive  Occupational  Data  Analysis  Programs 

DOS  - Defense  Occupational  Specialities 

Fto  - Field  Manuals 

FOJY  - Formal  On  The  Cob  Training 

GED  - General  Educational  Development 

HQ  - Headquarters 

ISO  - Instructional  Systems  Development 
ISS  - Installation  Support  School 
I TV  - Instructional  Television 
JPA  - Job  Performance  Aids 
OPi,  - Job  Performance  Measure 


!'.0R  - Knowledge  of  Results 
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LO  - Learning  Objective 
LS  - Learning  Step 

MODB  - Military  Occupational  Data  Bank 

MOS  - Military  Occupational  Specialities  (Army/Marine  Corps) 

MWO  - Modification  Work  Orders 
NIH  - Not  Invented  Here 

NOTAP  Nayal  Occupational  Task  Analysis  Program 

OJT  - On  i he  Job  Training 

OSR  - Occupational  Survey  Report 

POI  - Program  of  Instruction 

QQPRI  - Qualitative  and  Quantitative  Personnel  Requirements  Identification 

RS  - Resident  School 

SME  - Subject  Matter  Expert 

SMP  - System  Master  Plan 

S0p  - Standing  Operation  Procedures,  Standard  Operating  Procedures 
STEP  - Self-Teaching  Exportable  Package 
TAK  - Trainer  Appraisal  Kit 
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TI  - Traditional  Instruction 


GLOSSARY 


ABILITY  GROUPING:  Ai . angement  whereby  students  are  assigned  to  groups 
on  the  basis  of  aptitude  testing. 


ABSOLUTE  SiANOAROS:  A statement  defining  the  exact  level  of  performance 
required  of  a student  *s  a demonstration  that  he  has  mas- 
tered the  course  objective(s).  Criterion-referenced  tests 
are  usually  based  on  an  absolute  standard. 


ACHIEVEMENT  GROUPING:  Arrangement  whereby  students  are  assigned  to 

groups  according  to  their  performance  on  pretests  of  units 
o.  the  course. 


ACTION:  Occurs  in  terminal  learning  objectives  and  learning  objectives j 
describes  the  specific  behavior  the  learner  is  to  exhibit 
after  training. 


ACTION  VERBS:  Verbs  that  convey  action  and  reflect  the  type  of  learn- 
ing that  is  to  occur.  Action  verbs  must  reflect  behaviois 
that  are  measureable,  observable,  verifiable,  and  reliable. 


ACTIVITY  STEP:  One  simple  operation  or  movement  that  comprises  part  of 
a job.  A job  performance  standard  consists  of  a list  of 
these  operations  or  movements. 


ADJUNCT  PROGRAMMING:  A method  of  combining  the  features  of  good  exist- 
ing inrtructional  materials  (e.g.,  films,  textbooks)  with 
special  directions  or  Questions  to  guide  the  learner. 


ADMINISTRATIVE  CRITERIA:  In  media  selection,  the  options  that  course- 

ware be  developed  locally  or  at  sane  central  location. 


ALGORITHM:  A rule  or  procedure  for  accomplishing  a task  or  solving 
a problem. 


ALPHANUM  ,T!C:  Refers  to  a combination  of  letters  and  numbers;  for 

example,  on  the  keyboard  of  a teletype. 


ALTERNATE  PATH:  Refers  to  elements  which  have  relationships  in  which 
the  specific  situation  encountered  determines  the  appro- 
priate sequence,  or  it  may  be  another  way  of  meeting  the 
same  object 've. 
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ASSESSMENT:  A judgment  of  the  effectiveness  end  efficiency  of  a 

training  system.  In  terms  of  measurement  and  evaluation. 


ASSOCIATION  DEViCES:  Memory  aids,  techniques  which  ease  recall. 
Mnemonic  devices. 


ATTITUDE:  A persisting  state  of  a person  that  influences  his  choice 
of  action. 


ATTITUDE  MEASURE:  An  Instrument  designed  to  gather  Information  about 
how'  people  feel  toward  a particular  object.  This  could 
Include  liking  cr  disliking  subject  matter,  usefulness 
of  a medium,  or  opinions  about  the  medium. 


AUDIO-ONLY  PROGRAM:  A production  which  does  net  contain  any  video 
or  pictures;  for  example,  a record  or  radio  program. 


AUDIO  PRODUCER:  Prepares  tape  recordings  and  produces  audio  programs. 
The  audio  producer  combires  narration,  music,  ar.d 
other  sound  effects  in  the  production  of  an  audio  pro- 
gram. 


AUDIOVISUAL  MEDIA:  Refers  to  any  device  such  as  television  or  film 
which  is  both  seen  and  heard. 


BASELINE  DATA:  Valid  and  reliable  information  about  the  current 

leve1  of  performance  of  the  intended  student  population. 
This  data  can  be  used  to  confirm  the  need  to  develop  new 
instruction,  or  can  be  used  as  a comparisan  in  ascer- 
taining differences  between  students'  performance  be- 
fore and  after  instruction. 


BEHAVIORAL  ATTRIBUTES:  Qualities  or  activities  that  characterize  an 
object  or  process.  Behavioral  attributes  characterize 
each  category  of  learning. 


BLOCK  SCHEDULING:  Mode  of  instruction  whereby  all  students  receive 

the  same  instruction  at  the  came  time. 
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BLOCKING:  Refers  to  the  process  of  defining  and  Illustrating  the 
different  camera  movements  and  camera  shots  In  a tele- 
vision or  film  script.  A blocked  script  may  also 
contain  directions  as  to  the  movement  of  actors  as  well 
as  scenery  changes. 


CHECKLIST:  Job  performance  aid  which  lists  the  elements  of  a task 
in  the  sequence  of  execution.  The  job  holder  places 
a check  beside  each  element  as  it  Is  accomplished,  thus 
Insuring  that  the  task  is  completed. 


CHRHOLOGICAL  ORDFR:  Arranging  content  in  order  from  one  topic  to 
another  based  on  when  they  occurred  in  time. 


COMMON-FACTOR  LEARNING  OBJECTIVES:  Refers  to  learning  objectives  that 
are  identical,  or  that  have  identical  action  words  and 
similar  objects  of  the  rction  in  the  learning  objective 
statement. 


COMPARATIVE  SEQUENCE:  Sequencing  which  starts  with  familiar  topics 
and  goes  to  nnf ami liar  ones. 


COMPLEXITY  CRITERION:  In  media  selection,  the  degree  of  complexity 

required  of  instructional  materials  In  order  to  ade- 
quately train  students  to  meet  learning  objectives. 


COMPUTER  MODELS  TECHNIQUE:  Occurs  during  the  simulation  of  an  opera- 
tional system;  involves  having  a computer  simulate  the 
major  operations  of  the  system,  under  a variety  of  condi- 
tions. 


CONDITIONS:  Occurs  in  terminal  learning  objectives;  describes  what 
is  presented  to  the  student  in  order  to  accomplish  the 
specified  action,  that  is,  it  describes  the  important 
aspects  of  the  performance  environment. 


CONTIGUITY:  Refers,  i:.  learning,  to  the  principle  that  events  which 
occur  closely  together  become  associated  by  the  learner. 


CONTINGENCY  MANAGEMENT:  The  establishment  ot  a set  of  procedures  by 

which  trainees  are  req'ired  to  perform  a certain  amount  of 
work  or  to  achieve  certain  objectives  before  engaging  in 
activities  that  are  preferred  by  the  trainee  (e.g.,  recrea- 
tion, a break,  or  a more  desirable  training  event). 
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COURSE  DOCIMNTATION:  Information  describing  the  current  content 

of  a course  (Instructional  materials,  tests,  Instructor's 
manual,  evaluation  plan,  student's  manual)  and  its  develop- 
mental history  (job  analysis,  criteria  for  selecting  tasks 
for  training,  previous  revisions). 


CLUSTERING:  A process  of  organizing  many  tasks  into  groups  for  the 
purpose  of  deciding  upon  the  optimal  instructional  set- 
ting mix  tor  that  group  of  tasks. 


CRITERION-REFERENCED  TEST:  Measures  what  an  individual  can  do  or 
knows,  compared  to  what  he  must  be  able  to  do  or  must 
know  in  order  to  successfully  perform  a task.  Here  an 
individual's  performance  is  compared  to  external  cri- 
teria or  performance  standards  which  are  derived  from  an 
analysis  of  what  is  required  to  do  a particular  task. 


CRITICAL  CUE:  Cue  which  must  be  correctly  interpreted  by  the  student  be- 
fore we  can  correctly  perform  the  associated  task. 


CRITICAL  SEQUENCE:  Sequencing  of  topics  or  objectives  according  to 
their  importance. 


CUE:  A word  or  other  signal  that  initiates  or  guides  behavior;  a 
prompt. 

CUT-OFF  SCORE:  Minimum  passing  score. 
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DATA:  Collection  of  facts  or  numerical  values  resulting  from  observa- 
tions of  situations,  objects,  or  people. 


DATA  COLLECTION  PLAN:  An  outline  of  the  procedures  and  techniques 
that  will  be  used  to  gather  information  for  any  specific 
purpose. 


DATA  RECORDING  PLAN:  Method  of  tabulating  background  responses  and 
test  data. 


DECAY  RATE:  The  amount  of  time  it  takes  a trainee  to  forget  what  he 
has  learned  in  school.  If  the  decay  rate  is  high  then  a 
trainee  should  not  receive  instruction  in  a specific 
task  until  shortly  before  he  will  actually  perform  it. 
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DECISION  TREE:  Flowchart;  graphic  representation  of  the  sequence  of  a 
specific  activity  or  operation. 


DELIVERY  jYSTEM:  Any  method  containing  plans  and  procedures  for  the 
presentation  of  Instruction.  Platform  instruction,  tele- 
vision, FOOT,  and  STEPs  are  all  delivery  systems. 


DEPENDENT  RELATIONSHIP:  Occurs  when  skills  and  knowledges  in  one 
learning  objective  are  closely  related  to  those  in  the 
other  learning  objective.  In  order  to  master  one  of  the 
learning  objectives,  it  is  first  necessary  to  learn  the 
other. 


DOWNHME:  Refers  to  the  period  of  time  when  equipment  is  inoperable. 


DUTY:  One  of  the  major  subdivisions  of  wo r!i  performed  by  one  indi- 
vidual. One  or  more  duties  constitute  a job. 


DUTY  TITLE:  Categorizes  groups  of  tasks  under  identifiable  head- 
ings to  help  in  the  organizing  of  lists  of  tasks. 


EMPIRICALLY  BASED  REVISION:  Revision  based  on  the  result  of  test 
data  and  the  collection  of  other  types  of  quantitative 
information. 


ENTRY  BEHAVIOR:  The  skill,  knowledge,  and/or  attitude  required  be- 
fore beginning  a new  segment  of  instruction;  also  may 
refer  to  the  capability  a person  r.us  prior  to  new 
learning. 


ENTRY  SKILLS:  Specific,  measurable  behaviors  that  have  been  determined 
through  the  process  of  analysis  of  learning  require- 
ments to  be  basic  to  subsequent  knowledge  or  skill  in  the 
course. 


ENTRY  SKILLS  TEST:  A measurement  instrument  designed  to  determine  if 
a student  already  possesses  certain  skills  or  knowledge 
needed  as  a prerequisite  before  undertaking  new  instruc- 
tion. 


ENTRY  TEST:  Contains  items  based  on  the  objectives  that  the  intended 
students  must  hive  mastered  In  order  to  begin  the  course. 
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ERROR  OF  HALO:  Occurs  when  an  observer  sometimes  allows  his  rating 
of  performance  to  he  influenced  by  his  general  impres- 
sion of  a person. 


ERRORS  OF  LOGIC:  Occur  whan  two  or  more  traits  are  being  rated.  It 
is  present  if  an  observer  tends  to  give  similar  ratings 
to  traits  which  do  not  necessarily  go  together.  The 
traits  are  related  only  in  the  mind  of  the  person  making 
the  error. 


ERRORS  OF  STANDARD:  Occur  when  observers  tend  to  rate  performers  too 
high  or  too  low  because  of  differences  in  their  standards. 


EVALUATION:  The  process  of  interpreting  the  results  of  measurement 
data  (e.g.,  tests,  JPMs)  for  the  purpose  of  making  a 
judgment  or  decision  on  the  instruction  or  on  the  success 
of  a trainee. 


EVALUATION  CRITERIA:  The  measures  used  to  determine  the  adequacy 
of  oerformance. 


EVALUATION  PLAN:  A method  or  outline  of  what  set  of  procedures  will 
be  used  to  gather  data  and  information  for  the  purpose 
of  assessing  a co.  se  of  instruction. 


EXTERNAL  CUES:  Signa's  for  acticr.  that  exist  outside  of  the  student 

(conditions,  features,  or  characteristics  of  the  job 
environment  that  trigger  action). 


FALSE  NEGATIVE:  Occurs  when  a person  can  perform  the  task  but 
receives  a failing  score  on  the  test. 


FALSE  POSITIVE:  Occurs  when  a person  cannot  perform  the  task  but 

receives  a passing  score  on  the  test. 


FEEDBACK:  The  return  of  information.  Information  on  student  per- 
formance is  "fed"  back  to  the  student  so  that  he  can 
improve  that  performance;  to  the  insti jctional  designer 
so  that  he  can  improve  materials  and  procedures  on  the 
basis  of  student  needs;  to  the  management  system  so  it 
ran  monitor  the  internal  and  external  integrity  of  the 
instruction  and  make  appropriate  revisions.  Or,  refers 
to  the  flow  ot  data  or  information  from  one  step  in 
the  ISD  Model  to  others. 


FOJT-- FORMAL  ON-THE-  10B  TRAINING:  This  type  of  training  takes  place 
in  the  actual  work  situation. 


FOLLOW-UP  ACTIVITIES:  The  work  events  that  occur  after  a course  of 
instruction  has  been  completed. 


FORMATIVE  EVALUATION:  The  iterative  process  of  developing  and 
improving  instructional  materials  and  procedures. 


FIDELITY:  Refers  to  how  well  the  actions,  conditions,  cues,  and 

standards  of  th°  JPM  approximate  those  of  the  task. 


FIELD  USER  NEEDS:  The  general  and  specific  duties  that  will  have 
•*  to  be  taught  to  the  trainee  if  he  is  to  be  able  to 

adequately  perform  in  a real  world  environment. 


FIRST  DRAFT  MATERIALS:  Any  materials  (book,  film,  etc.)  which  are 
rot  yet  committed  to  their  final  form.  First  draft 
re.ers  to  the  fact  that  the  materials  are  still  in 
'rough'  form  and  will  be  revised  on  the  basis  of  test 
results  and  other  data. 


FLOWCHART : A graphic  representation  of  the  sequence  of  a specific 
activity  or  operation!  decision  tree. 


FRONT  END  ANALYSE:  Refers  to  job  analysis,  selection  of  tasks  for 

training,  and  development  of  JPMs. 


FIXED  SEQUENCE:  Refers  to  elements  that  are  always  done  in  che  same 
order . 


GRAPHIC  ARTIST:  Designs  and  prepares  a wide  variety  of  visual  illu- 

strations such  as  graphs,  charts,  and  diagrams. 


GRAPHIC  SCALE:  Measurement  device  which  includes  some  type  of  number 
line  on  which  students  indicate  their  attitude  toward 
a social  object. 


GO  NO-GO:  Pass-fail;  criterion  of  evaluation  whereby  student  can- 

not be  "partially  correct".  He  is  either  100%  correct 
'go)  or  incorrect  (no-q^y . 
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GROUP  MANAGEMENT  PLAN:  Arrangement  whereby  Instruction  Is  scheduled 
and  condncted  for  groups  instead  of  individuals. 


GROUP  TRAINING:  A group  of  people  gathered  together  for  the  purpose 
of  receiving  information  or  Instruction  in  the  performance 
of  some  specific  task. 


HARD  DATA:  A direct  and  precise  measure  of  a specific  performance. 

A JPM  is  an  example  of  hard  data  while  an  attitude  question- 
naire is  a less  direct  measure,  providing  soft  da  ,a. 


HIGH  DENSITY  SIGNAL:  A signal  containing  many  cues.  A low  density 
signal  contains  few  cues. 


INDEPENDENT  RELATIONSHIP:  Occurs  when  skills  and  knowledges  in  one 
objective  are  unrelated  4.0  those  in  the  other  objective. 
Mastering  one  of  the  objectives  does  not  simplify  the 
other. 


INDICATOR  BEHAVIOR:  Refers  to  that  behavior  that  indicates  the 
presence  of  a specific  attitude. 


INDIVIDUALIZED  INSTRUCTION:  Refers,  in  the  ISO  Model,  to  a management 

rcheme  which  norm its  individual  characteristics  of 
tra.neas  to  be  a major  determinant  of  the  kind  and  amount 
of  instruction  given.  Here,  it  nearly  always  implies 
some  form  of  self-pacing. 


INSTALLATION  SUPPORT  SCHOOLS:  Organized  and  operated  by  individual 

units  or  commands  to  meet  local  training  requirements. 


INSTRUCTIONAL  CONDITIONS:  The  amount  of  participation  which  the 
instruction  requires  OiT  the  learner.  Instructional 
conditions  may  be  active  (the  lea  aer  produces  or  prac- 
tices) or  passive  (the  learner  sits  and  listens). 


INSTRUCTIONAL  DESIGNER:  Person  who  designs  and  d^/elops  a program  or 

course  of  studies  based  on  - systematic  analysis. 


INFORMATION:  Knowledge;  the  facts,  names,  labels,  and  larger  bodies 

of  knowledge  that  are  necessary  for  successful  job 
performance. 
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INSTRUCTIONAL  MANAGEMENT  PLAN:  The  specifications  Tor  the  scheduling , 
Instruction  and  evaluation  of  trainees  toward  the  goal  of 
course  completion. 


INSTRUCTIONAL  PROGRAM:  The  development  of  various  materials  (books, 
audiovisual  oroductioi.s,  etc.)  designed  to  achieve  a 
specific  training  goal. 


INSTRUCTIONAL  SETTING:  The  vehicle  through  which  a trainee  who 

initially  is  net  able  to  perform  a task  becomes  profi- 
cient In  performing  the  task;  for  example,  performance 
aids,  self-teaching  exportable  packages,  formal  on-job 
training,  installation  support  schools,  and  resident 
schools. 

I INSTRUCTIONAL  $UPP0RT:  Learning  resources;  different  kinds  of 

material,  number  of  instructors,  amount  of  time,  etc. 
which  will  contribute  to  the  learning  situation. 


! INSTRUCTIONAL, SYSTEM:  The  total  effort,  distinct  from  the  operating 

system  by  location,  authority,  or  mission,  that  is  con- 
cerned with  the  preparation  of  individuals  to  serve  tl.e 
operating  system. 


INTERNAL  CUES:  Internal  biological  signals  that  initiate  or  guide 
behavior. 


INTERNAL  EVALUATION:  Assessment  of  the  effectiveness  of  an  instruc- 
tional program  in  terns  of  student  performance  on 
stated  terminal  learning  objectives. 


JOB:  The  duties  and  iasks  performed  by  a single  worker  constitute 
his  job.  If  identical  duties  and  tasks  are  performed  by 
several  individuals,  they  all  hold  the  same  job.  The 
job  is  the  basic  unit  used  in  carrying  out  the  personnel 
actions  of  selection,  training,  classification,  and 
assignment. 


JOB  ANAUilS:  The  basic  method  used  to  obtain  a detailed  listings  of 
duites,  tasks,  and  elements  necessary  to  perform  a 
clearly  defined,  specific  job,  involving  observations  of 
workers  and  conversations  with  those  who  know  the  job. 

In  o^der  to  describe  In  detail  the  work  involved,  includ- 
ing conditions  and  standards. 
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JOB  FIDELITY:  The  degree  to  which  a testing  situation  truthfully 
and  accurately  reflects  the  job  situation. 


JOB  PERFORMANCE  MEASURES:  Tests  that  are  used  to  evaluate  proficiency 
of  a job  holder  on  each  task  he  performs. 


JOB  PERFORMANCE  TEST:  Test  used  to  detemi^e  whether  or  how  well  an 
individual  can  perform  a job.  jn  may  include  either  all 
of  the  job  performance  measures  for  a particular  job  or 
a subset  of  the  job  performance  measures. 


JPA—  JOB  PERFORMANCE  AID:  A checklist,  instruction  sheet,  or  other 
device  that  offers  a possible  alternative  to  training 
rather  than  an  actual  method  of  training;  they  are  de- 
veloped to  eliminate  or  minimize  training  requirements 
for  some  tasks. 


KNOWLEDGE  OF  RESULTS:  Feedback;  information  provided  to  the  student 

indicating  lue  correctness  of  his  response.  Evaluative 
knowledge  of  results  indicates  what  a student  is  doing 
right  and  what  he  is  doing  wrong.  Comparative  knowledge 
of  results  indicates  how  the  student's  response  compares 
to  the  objective  or  standard  established  by  the  inst  mo- 
tor. 


LEARNER  CriARACTERICTJCS:  The  traits  possessed  by  learners  that  could 
affect  their  ability  to  learn  (e.g.,  age,  I.Q,,  reading 
level,  etc.). 


LEARNING  ACTIVITY:  The  specific  behaviors  a studert  performs  during 
a particular  episode  of  learning. 

LEARNING  ANALYSIS:  A procedure  to  idencify  subelements  that  must  be 
learned  oefore  a person  can  : thieve  mastery  of  the 
performance. 


LEARNING  CATEGORY:  A division  of  leaning  behavior.  All  learning 
may  be  classified  into  one  of  four  learning  categories: 
mental  skill,  physical  skill,  information,  or  attitude. 


LEARNING  EVENT:  The  immediate  outcome  of  a learning  activity. 
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LEARNING  GUIDELINES:  Statements  which  specify  the  learning  events 
and  activities  appropriate  to  specific  instruction. 
Learning  guidelines  combine  to  form  learning  sub- 
categories. 


LEARNING  HIERARCHY:  Graphically  portrays  the  relationships  among 
learning  tasks  in  which  some  tasks  must  be  mastered 
before  others  can  be  learned. 


LEARNING  OBJECTIVE:  Describes  precisely  what  is  to  be  learned  in 
terms  of  the  expected  student  performance  under  speci- 
fied conditions  to  accepted  standards.  These  learning 
objectives  identify  the  mental  skills,  information, 
attitudes,  or  physical  skills  that  are  required  to  per- 
form the  terminal  learning  objective. 


LEARNING  RESOURCE  CENTER:  Library  containing  instructional  materials 
and  areas  for  viewing  and  study. 


LEARNING  STEP:  Occurs  when  learning  objectives  are  broken  down  Into 
smaller  parts. 


LEARNING  SUB-CATEGORY:  A division  of  a learning  category. 


LEARNING  TASK  ANALYSTS:  Procedure  used  in  the  domain  of  intellectual 
skills  to  identify  prerequisite  tasks  that  must  be 
learned  before  a person  can  learn  a given  task. 


LINK  TRAINER:  Mechanical  training  device  which  simulates  the  cock- 
pit of  an  aircraft. 


RESPONSE  BIAS:  Tendency  to  favor  a certain  response  over  others. 


MANAGEMENT  PLAN:  Program  for  the  assignment,  monitoring,  and  assess- 
ment of  the  personnel,  materials,  and  resources  dedi- 
cated to  a specific  mission,  operation,  or  function. 


MASTERY:  In  terms  of  learning,  refers  to  meeting  all  c*  the  specified 
minimum  requirements  for  a specific  performance.  Criteria 
for  mastery  are  defined  in  the  design  phase  of  the  ISO 
Model . 
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MEAN:-  Arithmetic  average  calculated  by  adding  up  all  scores  and 
dividing  by  the  number  of  scores. 


MEASUREMENT : Consists  of  rules  for-  assigning  numbers  to  objects  to 
represent  quantities  of  attributes. 


MEASUREMENT  ERRORS:  Incorrect  procedures  ca  Tied  out  during  the 

measurement  process  which  invalidate  the  results.  These 
errors  result  from  unfounded  assertions  made  by  judges 
or  raters. 


MEASUREMENT  PROCESS:  The  operations  Involved  In  determining  the 

amount  of  an  attribute  (e.g.,  skill,  knowledge,  or  attl 
tude)  possessed  by  a student. 


MEDIA:  Means  for  presenting  instructional  material  to  learners;  for 
example,  books,  audiotapes,  and  filmstrips. 


MEDIA  ALTERNATIVE:  A form  of  instructional  material  that  contains 
the  stimulus  criteria  required  by  a specific  learning 
activity. 


MEDIA  MIX:  Combination  of  different  media  used  to  present  a unit  of 
instruction. 


MEDIA  POOL:  All  of  the  media  options  suitable  for  a given  unit  of 
instruction.  The  final  media  choice  is  drawn  from  the 
media  pool. 


MEDIA  SELECTION:  Is  the  major  means  of  determining  how  instruction  is 

to  be  packaged  and  presented  to  the  student. 


MENTAL  SET:  A preparatory  mental  adjustment,  or  readiness,  for  a 
parti cul  >r  type  of  experience. 


MENTAL  SKILLS:  Those  processes  of  identifying,  classifying , using 
rules,  and  solving  problems  that  involve  active  mental 
processing.  Mo.ital  skills  imply  the  capability  of 
a; plying  the  learning  to  some  situation  and  demonstrating 
th*  mental  skill,  such  as  thinking,  creating,  and 
analyzing. 
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MNEMONICS:  Methods  which  make  information  easier  to  remember;  memory 
aids. 


MODE  OF  INSTRUCTION:  Method  of  scheduling  materials  presentation.  The 
instructional  mode  may  be  individualized  (self-pacing)  or 
group  (block  scheduling). 


MODULE:  An  individualized  self-instructional  package  usually  con- 
taining all  the  necessary  materials  a learner  needs  to 
meet  some  or  part  of  a terminal  learning  objective. 


MULTIMEDIA  PACKAGE:  Self-contained  instructional  unit  in  more  than 
one  medium. 


NARRATION:  Is  the  voice  overheard  on  an  audiovisual  program. 


NARRATOR:  Is  the  person  whose  voice  is  heard  describing  or  commenting 
upon  the  content  of  a film,  television  program,  etc. 


NUMERICAL  SCALE:  Measurement  device  which  associates  verbal  descrip- 
tions of  social  objects  with  numbers  and  requires  students 
to  indicate  their  attitudes  by  marking  the  appropriate 
number. 


OBSERVATION  INTERVIEW:  Job  holder  is  observed  in  the  job  environment 
performing  all  or  a substantial  part  of  the  job;  the  joL 
holder  performs  the  job  while  the  analyst  ask  questions. 


OFF-LINE:  Refers  to  any  activity  which  does  not  take  place  as  part 
of  the  regular  production  process. 


OVERLEARNING:  Refers  to  the  continual  practice  on  a learning  task  by  a 
person  who  has  correctly  performed  the  task. 


PEER  TUTORING:  A form  of  instruction  in  which  students  at  the  same 
or  more  advanced  level  of  knowledge  provide  instruction 
to  students  at  the  same  or  lower  level  of  knowledge  on 
the  specific  objectives  under  consideration.  Peer  tutors 
are  not  members  of  the  existing  instructional  establish- 
ment. 
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PERFORMANCE  EVALUATION:  The  gathering  of  uata  to  specifically 

determine  the  success  of  students  on  a specific  task, 
as  a result  of  a training  program. 


PERFORMANCE  MEASURES:  The  absolute  standard  by  which  a .job  perfor- 
mance is  judged.  A performance  measure  Is  the  inven- 
tory of  job  tasks  with  each  performance  objective. 


PERSE  ERATE:  Continue  an  activity  until  it  is  completed,  regardless 
cf  the  difficulty,  or  the  appropriateness  of  the  solu- 
tion technique  to  the  problem. 


PERT— PROGRAM  EVALUATION  REVIEW  TECHNIQUE:  PERT  is  a method  of  moni- 
toring The  flow  of  a large  project  by  breaking  it  down 
into  small  individual  activities  and  assigning  each 
activity  a specified  .'.mount  of  time  for  completion. 


PHYSICAL  SKILLS'.  Specified  muscular  activities  for  arcompl’shing 
a goal. 


POST  FEEDBACK  DELAY:  The  pause  which  follows  the  presentation  of 
feedback.  This  allows  time  for  the  correct  response  to 
"sink  in." 


POSTTEST:  A test  administered  after  the  completion  of  instruction  to 
assess  whether  a student  has  mastered  the  objectives  of 
the  course  or  unit. 


PREDICTIVE  VALIDITY:  The  ability  of  a test  score  to  accurately  fore- 
cast future  performance. 


PREDIFFERENTIATION  OF  STIMULI:  Pointing  out  the  distinguishing 

features  of  an  object  and  explaining  the  differences 
between  them. 
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PRETEST:  Administered  prior  to  instruction  to  determine  how  much 
the  student  already  knows. 
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PROCESS  EVALUATION:  An  early  stage  in  ISD  development  that  identifies 
which  steps  in  the  model  will  be  used  for  the  rourse  under 
development.  The  purpose  of  the  process  evaluation  is  to 
describe  and  document  the  actual  developmental  process  f r 
this  particular  instruction. 
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PROCESS  STANDARDS:  Refers  to  the  conditions  which  must  be  sotisfied  for 
a job  to  be  successfully  rompleted.  Process  standards  refer 
to  sequence,  accuracy,  speed  of  perfortnancc,  and  complete- 
ness. 


PROGRAMMED  TNSTRUCTION:  Instructional  materials  which  present  subject 
matter  in  a series  of  small  sequential  units  which  require 
responses  from  'he  student. 


PROMPT:  A word  or  other  signal  that  initiates  o'"  guides  behavior; 
a c.ue. 


QUALITY  CONTROL:  Process  of  measuring  and  evaluating  in  order  to  main- 
tain course  standards  through  adjustments  in  instructional 
mterials  or  procedures. 


QUALITY  CONTROL  DATA:  Information  which  reflects  the  degree  of  success 

achieved  by  a system  or  operation. 


RANDOM  SELECTION:  Choosing  people  or  objects  at  random  rather  than 
according  to  some  systematic  plan. 


RANK  ORDER:  The  assignment  of  ranks  to  students.  This  could  refer  to 
groups,  such  as  the  top  10%,  or  simply  listing  each  stu- 
dent from  highest  to  lowest.  Rank  ordering  is  appro- 
priate when  there  is  a reed  to  select  the  fastest,  the 
most  accurate,  or  the  best  producer. 
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RATING  ERRORS:  Errors  of  standards,  ratio,  and  logic. 


RATING  SCALE:  A measurement  devi'e  in  which  a student  must  choose  a 
response  from  a range  of  choice?  arranged  in  a continuum 
from  low  to  high  or  good  to  bad,  etc. 


REGULATIONS:  Rules  for  appropriate  conduct  and  bahavior. 


RELIABILITY:  The  consistency  with  which  a test  measures  the  amount  of 
student  acnievement. 


RESIDENT  SCHOOLS:  These  schools  are  designed  to  meat-  service-wide 
training  requirements. 
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REVISION  PLAN:  A detailed  outline  of  the  procedures  to  be  taken 
to  modify  the  structure  or  content  of  a course. 


REWARD  SEQUENCE:  Scheduling  the  more  pleasant  activity  to  follow 
the  less  pleasant  activity;  can  be  used  to  provide 
a reward  for  completion. 


SAMPLE:  A portion  or  small  segment  of  the  students  for  whom  instruc- 
tion is  designed. 


SAMPLING  PLAN:  Procedure  for  selecting  a small  but  representative 
group  from  a larger  population. 


SCALE:  In  media  selection,  some  materials  must  represent  actual 

objects  and  accurately  represent  the  dimensions  of 
those  objects.  A model  may,  for  example,  be  full 
scale,  half  scale,  or  on  a 1 to  10  scale  with  the 
actual  object. 


SElF  PACING:  Mode  of  instruction  whereby  each  student  works  through 
the  instructional  materials  at  his  own  rate  of  speed. 


SELF-PACED  MANAGEMENT  PLAN:  Arrangement  whereby  instruction  is 

scheduled  and  conducted  for  individual  students  rather 
than  groups  of  students. 


SELF-TEACHING  EXPORTABLE  PACKAGES:  Self  instructional  study  units; 

generally  sent  to  the  student  wherever  he  is  stationed. 


SEQUENCING:  Ordering  instruction;  proper  sequencing  allows  the 
learner  to  make  the  transition  from  one  skill  or  body 
of  knowledge  to  another,  and  assures  that  supporting 
skills  and  knowledge  are  acquired  before  dependent 
performances  are  introduced. 


SHAPING:  Gradually  changing  a student’s  behavior  until  it  is  correct. 


SIGNAL.  Cue  that  initiates  and  directs  activity. 
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SIMULATION:  Any  change  from  reality  or  any  imitation  of  reality. 

Three  types  are  cannon:  simulating  part  of  the  system, 
simulating  the  operation  of  the  system,  and  simulating 
the  environment  in  which  the  system  will  operate. 


SIMULATORS:  Machines  or  processes  designed  to  piovide  training  which 
will  have  high  positive  transfer  to  the  real  world  equip- 
ment or  situation.  Simulators  are  o-dinarily  cheaper, 
safer,  or  more  available  than  the  actual  situation  or 
equipment. 


SLIDE-TAPE:  A combination  of  visual  slides  and  an  audio  tape  syn- 
chronized so  that  the  audio  describes  the  content  of 
the  slides. 


SOFT  DATA:  Obtained  from  attitude  or  opinion  surveys.  This  data  is 
not  as  reliable  as  hard  data. 


STANDARDS:  Occurs  in  terminal  learning  objectives  or  learning 

objectives;  describes  the  criterion  or  standard  of  per- 
formance which  must  be  attained. 


STIMULUS  CRITERIA:  Those  basic  qualities  or  capabilities  of  a 

medium  that  are  required  to  carry  out  the  intent  of  the 
learning  activity;  for  example,  visual  images,  motion, 
color,  and  sound. 


STORYBOARD:  A collection  or  series  of  small  pictures  which  describe 
the  action  and  content  that  will  be  contained  in  an  audio* 
visual  or  visual -only  production.  F.  sequence  of  these 
small  pictures  comprise  a storyboard. 


SUBJECT  MATTER  EXPERT:  A person  who  has  professional  skill  in  the 
performance  of  some  job  and  who  is  consulted  by  an  in- 
structional designer  in  the  process  of  job  task  analysis. 


SUPPORTIVE  RELATIONSHIP:  Occurs  when  skills  and  knowledges  in  one 
objective  have  sane  relationship  i'.  t.nose  ir.  the  other 
objective;  the  learning  involved  in  .mastery  of  one  learn- 
ing objective  transfers  to  the  other,  making  learning 
involved  in  the  mastery  of  the  other  easier. 


SYMBOL:  Anything  that  stands  for  or  represents  something  else.  A 
plus  sign  {+)  is  a symbol  for  the  mathematical  operation 
of  addition. 


SYSTEM  MASTER  PLAN:  Control  document  used  to  coordinate  the  develop- 
ment and  implementation  of  an  instructional  p-ogram. 


SYNCHRONIZING  PULSE:  An  audible  or  inaudible  sound  used  to  coordinate 
the  audio  and  video  portions  of  a slide-tape  program  so 
that  audio  and  video  (i.e.,  slide  and  narration)  are 
coordinated. 


SYSTEMS  APPROACH:  A generic  term  referring  to  the  orderly  process  of 
analysis,  design,  development,  evaluation,  revision,  and 
operation  of  a collection  of  Interrelated  elements. 


TALK-THROUGH  TECHNIQUE:  Occurs  during  the  simulation  of  an  operational 
system;  involves  talking  through  each  operation  in  the 
new  system  to  determine  deci cions  and  contingencies. 


TARGET  POPULATION:  The  pool  of  potential  entrants  to  training  for 

which  instructional  materials  are  designed  and  tried  out. 


TASK  PELAY  TOLERANCE:  A measure  of  how  much  delay  can  be  tolerated 
between  the  time  the  need  for  task  perfomance  becomes 
evident  and  the  time  actual  performance  must  begin. 


TASK:  Formed  in  clusters  which  make  up  duties.  A task  is  the  lowest 
level  of  behavior  i a jo  that  dcsct  bes  the  performance 
of  a meaningful  funct  in  in  the  job  under  cons i deration. 


TASK  INVENTORY:  List  that  itemizes  all  of  the  tasks  that  make  up 

a selected  duty. 


TASK  LEARNING  DIFFICULTY:  Refers  to  time,  effort,  and  assistance  re 

quired  by  a student  to  achieve  performance  proficiency. 


TALK  STANDARD:  A statement  of  how  well  a task  must  be  performed. 
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TASK  STATEhitNT:  A statement  of  highly  specific  action  which  has  a 
verb  and  object;  for  example,  ;ort  mail. 


TECHNICAL  ORDERS:  Military  regulations  whicn  ^eal  with  the  specific 
nature  of  technical  materials  and  equipment. 


TERMINAL  LEARNING  OBJECTIVE:  Derived  from  job  performance  measures, 
TLOs  are  to  be  attained  during  training.  TLOs  are  broken 
down  into  their  component  parts  which  are  documented  as 
learnirj  objectives  which  may  be  further  divided  into 
learning  steps.  Each  TLO  contains  actions,  conditions, 
and- standards. 


TESTS:  Any  device  or  technique  used  to  measure  the  performance  of  a 
student  on  a specific  task  or  subject  matter. 


TESTING 

L 


CONSTRAINTS:  Limitations  such  as  time,  money,  personnel, 
facilities,  and  other  resources,  which  prohibit  job 
performance  measures  from  being  identical  to  the  tasks 
they  measure. 


TRADE-OFFS:  In  any  systematic  approach  to  instruction,  it  is 

necessary  to  make  compromises  between  what  is  desiraole 
and  what  is  possible.  Ordinarily,  these  decisions  in- 
volve increases  or  decreases  in  time,  money,  facilities, 
equipment,  or  personnel.  Training  aids  and  simulators 
represent  examples  of  trade-offs. 


TRAINER  APPRAISAL  KIT:  A package  of  instructional  materials 
aesigned  to  provide  a course  instructor  with 
practice  in  the  preparation,  presentation,  and  valida- 
tion of  instruction. 


TRAINING:  The  teaching  of  job  skills.  It  can  take  a number  of  forms 
such  as  self-teaching  exportable  packages,  training 
manuals,  individual  learning  packages,  FOJT,  or  group 
training. 


TRAINING  SETTING  CRITERIA:  In  media  selection,  the  options  that 

trairing  must  be  either  sm?ll  group,  large  group,  indi- 
vidualized at  a fixed  location,  or  individualized  inde- 
pendent of  location. 
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TRYOUT:  Practice  test;  the  purpose  is  to  make  the  tryout  as  realistic 
as  **ossible  by  eliminating  as  many  sources  of  unreliability 
as  possible. 


UNOFRfRAIN:  Provide  inadequate  training  that  does  not  prepare  a 
student  to  meet  regular  job  performance  requirements. 


VALIDATION:  A process  through  which  a course  is  revised  until  it 
is  effective  in  realizing  its  instructional  goal. 


VALIDATION  DOCUMENTATION:  A report  which  describes  in  detail  how 
a specific  course  of  instruction  was  validated  and  for 
what  target  population. 


VALIDATION  PROCESS:  Testi.ig  instructional  materials  on  a sample  of 
the  target  population  to  insure  that  the  materials  are 
effective. 


VALIDITY:  The  degree  to  which  a test  measures  what  it  claims  to 
measure. 


VALUE  ENGINEERING:  Refers  to  the  process  of  designing  equipment 

or  instruction  to  meet  but  not  exceed  the  required  out- 
comes. Ordinarily,  it  refers  to  the  elimination  of 
features  or  instructional  objectives  that  have  not  been 
demonstrated  to  be  Dosi lively  necessary. 


VIGILANCE  LEVEL:  General  degree  of  watchfulness  or  attentiveness 
to  what  may  come. 


VISUAL  FORM:  In  media  selection,  refers  to  whether  alphanumeric  or 

pictorial  characteristics  are  required  in  a learning 
situation. 


VISUAL  SPECTRUM:  The  type  of  color  required  of  instructional 

materials.  Some  must  be  with  full  color,  others  may 
be  with  black  and  white  or  shades  of  grey. 


WITHIN-COURSE  TESTS:  Administered  during  a course  of  instruction 

to  assure  that  all  students  are  "’'eeping  up"  with  the 
learning  objectives. 
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WORK  ELEMENTS:  The  element  Is  the  smallest  component  In  the 

structure  of  a job.  Elements  combine  to  form  a task, 
tasks  combine  to  form  a duty,  and  duties  combine  to 
form  a job. 
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,5. 


NOTE:  The  Roman  numerals  following  each  entry  refer  to  the  Phase 

numbers;  the  Arabic  numerals  refer  to  the  page  numbers. 


Ability  grouping.  III:  125 
Achievement  grouping.  III:  125 
Activities,  see  Learning  activities 
Adjunct  programs.  III:  251 
Affective  component:  attitude 
learning.  III:  66-67,  103 
Air  Force  Specialties  (AFS),  I:  3,8 
Algorithms,  III:  20-22,  71-104 
Antisubmarine  warfare  (ASW) 

training  program.  Navy,  III:  142 
Attitude  learning:  learning  sub- 
category 11,  III:  66-70,  103-104 
affective  component.  III:  66-67, 
103 

behavioral  component.  III:  66, 
70,  104 

cognitive  component.  III:  66, 
67-70,  104 

Audio  producer  (production  person- 
nel), III:  228 

Audio-visual  production,  III:  235- 
244 


Baseline  data  collection,  V:  25-26, 
70-71 

Behavioral  component:  attitude 
learning.  III:  66,  70,  104 
Block  scheduling  (group  instruc- 
tion plan).  III:  124-125 


Classifying:  learning  sub- 
category 2,  III:  38-40,  74-75 
Clustering,  task,  I:  244-245 
Cognitive  component:  attitude 
learning.  III:  66,  67-70,  104 
Command  Job  Analysis,  schedule  for, 
I:  58 

Common-factor  learning  objectives, 
II:  90-92 

Comprehensive  Occupational  Data 
Analysis  Program  (COOAP), 

I:  121 


Computer-assisted  instruction  (CAI), 
III:  191 

Computer-managed  instruction.  III: 
191-194 

Conditions,  JPM,  I:  177-178 

on-the-job,  task,  I:  24-26,  89-93 
Cc.it’ quity.  III:  41 
Conti ngency-managed  i ns  tructi on , 

III:  187-189,  215 

Contract,  student  (or  performance), 
III:  189 

Cues,  JPM,  I:  179 

prompts  for  student  learning.  III: 
6-8 

task,  I:  25,  27-28 


Data  collection, 

for  external  evaluation,  V:  68-77 
for  internal  evaluation,  V:  1-8, 
29-46,  53-62 
for  JPMs , 1:45-46 
for  rating  tasks,  I:  133-139 
Data  collection  plan  for  job  analysis, 
alternate  or  short-cut,  I:  47, 

77-78 

form  preparation,  I:  49-51,  59 
group  interviews,  I:  40 
individual  and  observation  inter- 
views, I:  36-37,  41-46,  52-62 
jury-of-experts,  I:  39-40 
questionnaire  survey,  I:  37-39, 

45,  46,  68-73 

Decision-making:  learning  sub-category 
5,  III:  46-48,  83-86 
Decisions,  management,  Executive 
Summary:  20,  24-25,  30-32,  3IT-37, 
42-437  51  , 54-55,  59,  63,  69-70, 
75-76,  81-82,  85-86,  91-92,  96-97, 
100-101  , 108-109,  114-r.J,  119-120 
Decision  trees,  see  Algorithms 
Defense  Occupational  Specialties  (DOS), 
I:  3,  8,  2i4 

Delay  tolerance,  see  Task  delay  ... 
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Preceding  page  blank 
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Delivery  system,  III:  213-214, 
see  also  Media  and  Instructional 
management  plan  and  delivery 
system 

Detecting:  learning  sub-category  4, 
III:  43-45,  78-82 
Duty,  I:  11-12 


Electronic  technician  (production 
personnel).  III:  229 
Element(s),  I:  17-22 

al  ternate-pa,th , I:  22-24 
fixed-sequence,  I:  22-24 
Entry  behavior,  student,  II:  62-77 
definition  of,  II:  62-63 
entry  tests  for,  II:  70-72 
outputs,  II:  76 

procedures  for  determining,  II: 
64-75 

purpose  of  establishing,  II: 
62-63 

pretesting,  II:  62,  73-75 
remedial  or  preparatory 
instruction,  II:  69 
revise/ test  procedure,  II:  69 
tests  to  verify  assumptions 
about,  II:  63-69 

Entry  test,  development  of,  II:  72 
need  for,  II:  70-72 
Equipment-oriented  jobs,  I:  81-83 
Errors  in  measuring  and  testing, 

I:  201-205;  IV:  33 
of  halo,  I:  203-204;  IV:  33 
of  logic,  I:  204-205 
of  standard,  I:  202;  IV:  33 
Evaluation,  external,  see  External 
evaluation 

Evaluation,  internal,  see  Internal 
evaluation 

Existing  courses,  analysis  of,  I: 
213-229 

development  documentation  for, 
I:  220 

evaluating  existing  job  analy- 
ses for,  I:  215-216,  221-222 
evaluating  existing  Job  Perform 
ance  Measures  for,  I:  216, 
225-226 

evaluating  tasks,  I:  223-224 
evaluating  validation  documen- 
tation for,  I:  226 
Front  End  Analysis,  I:  216-218 


Existing  courses  (continued) 
outputs,  I:  218,  227-228 
procedures  for,  I:  218-227 
rationale  for,  I:  213,  215 
revisions  indicated  by,  I:  227 
Existing  materials,  review  of.  III: 
198-220 

collection  process  for.  III: 

202-203 

modifications  determined  by.  III: 
206-208,  212-213,  216 
outputs.  III:  216-217 
procedures  for.  III:  201-216 
rationale  for.  III:  198-201 
with  reference  to  delivery  system, 
III:  213-214 

with  reference  to  learner  charac- 
teristics, III:  203-205 
with  reference  to  learning  guide- 
lines, III:  208-213 
with  reference  to  management  plan, 
III:  214-215 

External  evaluation,  V:  63-86 

baseline  data  collection,  V:  70-71 
data  collection  methods,  V:  68-69 
data  collection  procedures,  V:  69- 
77 

data  consolidation,  V:  78-81 
data  requirements , V:  66-68 
data  sources,  V:  65-66 
documentation,  V:  84-85 
job  performance  evaluation  data 
collection,  V:  71-73 
outputs,  V:  83-85 
personal  interview  data,  V:  74-75 
planning  phase,  V:  65-69 
procedures,  V:  65-83 
purposes  of,  V:  63-65 
questionnaire  use,  V:  73-74 
recommendations,  V:  81-83 
records  of  students'  performance 
during  instruction,  V:  76-77 
report  (EXER),  V:  78,  83 
time  considerations,  V:  68 
External  Evaluation  Report  (EXER),  V: 
78,  83,  90-91,  93,  95-96,  105,  109- 
110,  112 


Feedback,  III:  6,  9-10 
Formal  On-the-Job  Training  (F0JT),  I: 
231,  237-238,  256-258;  III:  139- 
141,  260-262 
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Formative  evaluation.  III:  280-281 
Front  End  Analysis,  I:  216-218 


Graphic  artist  (production  person- 
nel), III:  227-228 


Hard  data,  V:  4 


Identifying  symbols,  learning  sub- 
category 3;  III:  41-42,  76-7? 

Installation  Support  Schools  (ISS), 
I:  238,  258-259;  III:  140-142 

Instruction,  conducting,  IV:  29-39 
course  documentation,  pre- 
instruction  review  of,  IV: 
32-34 

changes  in,  IV:  36-38 
documentation  of  changes, 
problems  for,  IV:  35-37 
follow-up  activities,  IV:  37-38 
function  of  instructor,  IV:  29- 
31,  32-38 
outputs,  IV:  38 
procedures,  IV:  32-38 
test  administration,  IV:  32-33, 
34-35 

training  of  instructors,  IV:  34- 
35 

Instruction,  development  of.  III: 
221-287 

adjunct  programs.  III:  251 
aims.  III:  221-223 
audio-only  script  guidelines, 
III:  230-232,  233 
audio-visual  production.  III: 
235-244 

Formal  On-the-Job  Training 
(FOJT) , III:  260-262 
Instructor's  Guide-  III:  265- 
266 

Job  Performance  Aids  (OPAs), 

III:  252-260 

needs  and  constraints.  III: 
224-225 

outputs,  III:  270 
platform  lectures,  III:  248 
pre-testing  of  d^aft  materials, 
III:  263-265 

printed  materials,  III:  246 


Instruction,  development  of  (con- 
tinued) 

procedures , III:  224-269 
production  personnel.  III:  227-229 
programmed  Instruction,  III:  246- 
247 


resources.  III:  225-230 
Self -Teaching  Exportable  Packages 
(STEPs),  III:  248-249 
slide-tape  production.  III:  239- 
244 


Students'  Guide,  III:  269 
supplementary  instruction.  III: 
249-250 

television  program  production, 
III:  244-246 

terms  defined.  III:  286-287 
types  of  instruction.  III:  230 
263 

user  Instructions,  III:  265 
video-only  materials.  III:  232, 
234-235 

Instructional  management  plan  and 
delivery  system.  III:  105-197 
block-scheduling  for  group 
instruction.  III:  124-125 
consumables  and  courseware.  III: 
136-137 

course  management.  III:  126-127 
definition.  III:  105 
equipment  and  facilities.  III: 
135-136 

for  instructors.  III:  131-135 
for  student  processing.  III:  127- 
130 


for  support  personnel,  III:  135 
function  of  guidelines,  III:  106- 
107 

group  assignment,  methods  of, 

III:  125 


management  guidelines.  III:  124- 
137 

media  costs.  III:  112 
media  mixes,  III:  107-118 
media  selection.  III:  118-124 
outputs,  III:  142-143 
procedures  for  specifying,  III: 
107-142 

program  completion.  III:  131 
self-pacing  mode.  III:  124,  125- 
126 

System  Master  Plan  (SMP),  III: 
105,  107,  138-142 
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Instructional  management  plan,  imple- 
mentation of,  IV:  1-18 
equipment,  IV:  15 
instructor's  manual,  reviewed 
and  supplemented,  IV:  4-5 
materials,  IV:  15 
procedures,  IV:  4-15 
space  allocation,  IV:  14-15 
staff  training,  IV:  7-12 
student  selection,  IV:  13 
student  manuals,  reviewed  and 
suppl emented , IV:  6 
time  allocation,  IV:  14 
time  relationships  within  ISD 
process,  IV:  3-4 
Trainer  Appraisal  Kit  (TAK), 

IV:  7-12 

Instructional  materials,  validation 
of.  III:  280-346 
attitude  measures.  III:  288, 
294-295 

data  analysis  plan.  III:  295-297, 

316 

data  collection  and  recording 
system.  III:  287-293,  314-316 
data  consolidating  and  analyzing, 
III:  304-308,  331 
group  trial,  administering,  III: 
328 

group  trial  procedures,  III:  316- 

317 

individual  trials,  plan  for  con- 
ducting instruction  for.  III: 
297-298 

individual  trials,  steps  in  con- 
ducting, III:  298-303 
learning  objective  rating.  III: 
317-327 

nature  and  purpose  of.  III:  280- 
285 

outputs.  III:  336-339 
participant  selection  for  group 
trials,  III:  31 7 „ 328 
plan  for  group  trials.  III:  312- 
328 

plan  for  individual  trials,  III: 
285-298 

platform  instruction.  III:  329- 
331 

procedures,  III:  285-336 
revision  of  attitude  measures, 

III;  316 


Instructional  materials,  validation 
of,  (continued) 

revision  requirements , III:  308- 
311,  332-336 

standards  and  constraints  for 
group  trials.  III:  313-314 
Instructional  methods  and  devices, 

III:  163-172 

audio-only  systems.  III:  163 
audio-visual  systems.  III:  163-166 
computer  simulation.  III:  166-168 
print  materials.  III:  169-171 
special  and  non-standard  items, 

III:  171-172 

visual-only  systems.  III:  168-169 
Instructional  setting(s),  selection 
of,  I:  230-264 

assignment  of  tasks,  I:  233-263 
clustering  tasks,  I:  244-245 
cost  analysis  for,  I:  240-242 
definition  of  instructional 
setting,  I:  230-231 
documentation  for,  I:  262-263 
Formal  On-the-Job  Training  (FOJT), 

I:  231,  237-238,  256-258 
group  training,  I:  239 
inputs,  I:  231-232 
Installation  Support  Schools  (ISS), 
I:  231.  238,  258-259 
Job  Performance  Aids  (JPAs),  I: 

231,  233-235,  236,  242,  245-249 
Job  Performance  Measures  in,  I: 

232 

outputs,  I:  262-263 
personnel  data  factor  in,  I:  249- 
250 

procedures,  I:  242-263 
Resident  Schools  (RS),  I:  231,  238- 
239,  259 

revision  of  task  assignments,  I: 
260-262 

Self-Teaching  Exportable  Packages 
(STEPs),  I:  231,  235,  237,  250- 
255 

work  experience,  I:  239-240 
Instructional  Systems  Development  (ISD) 
program,  documentation  for,  I: 
83-84,  87 

initiation  of,  I:  1-5 
purpose  of,  I:  2,  214 
rationale  for  sequence  of,  I:  5-6 
Instructional  television  (ITV),  III: 
194-195 
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Job  Performance  Measures  (con- 
tinued) 

in  selecti ng  Instructional 
settings,  I:  232,  <42 
In  system  revision,  V:  110-111 
In  testing,  II:  44 
Job  Performance  Measures,  con- 
struction of,  I:  156-212 
checklists  for,  I:  196-197,  211 
conditions,  I:  177-178 
cues,  I:  179 

cut-off  scores  for,  I:  200-201 
data  collection  for,  I:  45,  46 
documentation  for,  I:  191-193, 
209 

errors  in  measurement,  I:  201- 
205 


outputs,  I:  209 
part- task  testing,  I:  185-187 
physical  fidelity,  I:  161-163, 
167 

predictive  validity,  I:  158-161, 
167 


procedures  for,  I:  165-209 
process  and  product  rating,  I: 
170-171,  195-196 
rationale  for,  I:  155-157 
rating  scales  for,  I:  197-200 
sample  list  of  validated  JPMs, 
I:  210 

sampling  plan,  I:  187-191 
scoring  procedures,  I:  191, 
194-204 

simulator  requirements  for,  I: 
163,  172-176 
standards,  I:  180-184 
testing  constraints,  I:  166- 
170 

tryout  procedure,  I:  207-208 
types  of  tasks  measured,  I: 
164-165 

validation  and  revision,  I: 
205-209 

Job  Performance  Test  (JPT),  I:  158 
Jury-of-Experts,  I:  39-40,  41,  67 


Knowledge  of  results  (K0R) , III: 
31,  32,  33,  48,  51 


Learning  activities,  see  Learning 
events/activities,  specifying 


Learning  analysis,  II:  18-30 
attitude  category,  II:  28-30 
information  category,  II:  23-26 
mental  skills  category.  II:  19-23 
physical  skills  category,  II:  26- 
28 

Learning  categories  and  sub-categories, 
II:  16-17,  III;  11-17 
Learning  events/activities,  specifying, 
III:  1-105 

classification  of  learning 
objectives.  III:  10-17 
conditions  (active  vs.  passive), 

III:  4-5 

cues  or  prompts.  III:  6-8 
directions  for.  III:  24-26 
feedback.  III:  6,  9-10 
flowcharts  (algorithms),  III:  18, 

20,  71-104 

guidelines  for  eleven  sub- 
categories  of  learning.  III: 
17-18,  35-70 

learning  categories  with  sub- 
categories, III:  11-17 
learning  guidelines  (general).  III: 
3-6 

outputs.  III*.  26 
procedures,  III:  3-26 
purposes.  III:  1-3 
Learning  guidelines,  functions  of, 

III:  1-4,  208-213 
general.  III:  3-6,  10 
specific,  for  eleven  learning 
sub-categories,  III:  17-20, 

35-70 

sub-category  1:  rule-learning  and 
using.  III:  35-37,  71-73 
sub-category  2:  classifying.  III: 
38-40,  74-75 

sub-category  3:  identifying  symbols, 
III:  41-42,  76-77 
sub-category  4:  detecting.  III: 
43-45,  78-82 

sub-category  5:  making  decision*;, 
III:  46-48,  83-86 

sub-category  6:  recalling  bodies  of 
knowledge,  III:  49-52,  87-90 
sub-category  7:  performing  gross 
motor  skills,  HI;  53-55,  91-93 
sub-category  8:  steering  and  guid- 
ing, III:  56-57,  94-95 
sub-categoy  9:  positioning  move- 
ment, III:  58-62,  96-99 
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Learning  guidelines  (continued) 
sub-category  10:  voice  conwuni- 
cating.  III:  63-65,  100-102 
sub-category  11:  attitude 
learning.  III:  66-70,  103- 
104 

Learning  objectives  (LO),  II:  1, 

4-5,  8-30,  see  also  Objectives, 
comnon-f actor,  II:  90-92 
testing,  II:  36,  38,  39.  42-45, 
49-50,  64 

Learning  Objective  Analysis  Work- 
sheet, II:  7;  III:  27,  109,  224- 
225 

Learning  objectives,  sequencing  and 
structuring,  see  Sequence  and 
structure  of  Teaming  objectives, 
determining 

Learning  Resource  Centers  (LRCs), 
III:  141 

Learning  steps  (LSs),  II:  4,  5,  36, 
38,  57 


Management  decisions,  see  Decisions, 
management 

Management  guidelines,  III:  124-137 
Management  plan,  see  Instructional 
management  plan  and  delivery 
syst'  i 

Management  plans,  student,  III:  185- 
196 

combination  plans.  III:  196 
computer-managed  instruction, 

III:  191-194 

contingency-managed  instruction, 
III:  187-189 

ins true tor -managed  instruction, 
III:  186-187 

media-managed  instruction,  III: 
194 

peer-managed  instruction.  III: 
190-191 

student  self-managed  instruction, 
III:  195 

Marginal  students,  guidelines  for 
managing.  III:  129-130 
Materials,  existing— review  of, 
see  Existing  materials,  review  of 
Matrices  (for  media  selection).  III: 
113,  115-118,  172-184 
Media,  comparative  costs,  III:  112 


Media  (continued) 

decision  matrices  for  'election 
of.  III:  172-184 
evaluation  of,  see  Existing 
materials,  review  of 
revision.  III:  206-208 
selection  (for  Instructional 
management  plan),  III:  106- 
124,  172-184 

Media-managed  instruction.  III:  194 

Media  specialist  (production  person- 
nel), III:  227 

Military  Occupational  Specialties 
(M0S),  I:  3,  8 

Misclassifications,  in  testing,  II: 
52-55 

Mnemonics,  III:  31,  36,  41,  50,  59 


Non-equipment-oriented  jobs,  I:  79- 
81 


Objectives,  development  of,  II:  1- 
34 

action  statement,  II:  5-12 
conditions  statement,  II:  5-6, 
9-10,  13-14 

criteria  for  Terminal  Learning 
Objective  and  Learning  Objec- 
tive statements,  II:  8-16 
inputs,  II:  1-2 

Job  Performance  Measures  in,  II: 
2 

learning  analysis  for  each  Term- 
inal Learning  Objective,  II: 
18-30 

learning  analysis:  attitude 
category,  II:  28-30 
learning  analysis:  information 
category,  II:  23-26 
learning  analysis:  mental  skills 
category,  II:  19-23 
learning  analysis:  physical 
skills  category,  II:  26-28 
learning  categories,  II:  16-17 
learning  objectives  (LOs),  II: 
4-5,  8-30 

learning  steps  (LSs),  II:  4-5 
outputs,  II:  30 
procedures,  II:  6-30 
standards  statement,  II:  5-6, 
9-10,  14-16 
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Objectives,  development  of  (con- 
tinued) 

terminal  learning  objectives 
(TLOs)  preparation,  II:  2-5, 
6-16 


Peer-managed  instruction.  III:  190- 
191,  215 

Perceptual  set(s).  III:  46,  63 
Performance  Evaluation  Plan,  V:  22- 
28 

area  of  "entry  skills,"  V:  24- 
25 

area  of  “external  requirements," 
V:  23-24 

area  of  "tests,"  V:  25-26 
area  of  "time  required  to  com- 
plete instructional  units," 

V:  27-28 

Performing  gross  motor  skills: 
learning  sub-category  7,  III: 
53-55,  91-93 

Photographer  (production  personnel), 
III:  228 

Physical  fidelity,  of  Job  Perform- 
ance Measures,  I:  161-163,  167 
Platform  lectures,  III:  248 
Positioning  movement  and  recalling 
procedures:  learning  sub-category 
9,  III:  58-62,  96-99 
Post-feedback  delay.  III:  61 
Posttest,  V:  109-110 
Predictive  validity  of  Job  Per- 
formance Measures,  I:  158-161, 

167 

Predifferentiation  of  stimuli,  III: 
38,  41 , 49 
Pretest,  II:  73-75 
Print  specialist  (production  per- 
sonnel), III:  228 
Process  Evaluation  Plan.  V:  14-22 
Process  rating,  I:  196 
Product  rating,  I:  195 
Program  Evaluation  Review  Tech- 
nique (PERT),  V:  10 
Programmed  instruction,  III:  246- 
247 

Progress  Evaluation  Plan,  V:  11-14 


Questionnaii i survey,  administra 
tion  of,  I:  72-73,  106-112 


i 


Questionnaire  survey  (continued) 
closed  form,  I:  38-39- 
for  external  evaluation  data 
collection,  V:  73-74 
for  job  analysis,  I:  37-39,  44- 
46 

for  rating  tasks  for  training, 
I:  133-136 
open  form,  I:  38-39 
preparation  of,  I:  68-71,  134- 
136 

sample  selection  for,  I:  71-72, 
133-134 


Random  grouping.  III:  125 
Rank-order  testing,  II:  52-55 
Ratings  (Navy),  I:  3,  8 
Rating  scales  (for  Job  Performance 
Measures),  description  of,  I: 
197-198 

graphic,  I:  198-200 
numerical,  I:  197 
Recalling  bodies  of  knowledge: 
learning  sub-category  6,  III: 
49-52,  87-90 

Reinforcement;  reinforcer.  III: 
187-189 

Resident  Schools  (RS),  I:  238- 
239,  259;  III:  139-141 
Response  biases.  III:  46 
Revision  of  system,  see  System 
revision 

Revision  plan  format,  V:  113 
Rule-learning  and  using:  learning 
sub-category  1,  III:  35-37,  71-73 


Sampling  plan  for  Job  Performance 
Measures,  I:  187-191 
Self-pacing  instructional  plan.  III: 
124,  125-126 

Self-Teaching  Exportable  Packages 
(STEPs),  I:  231,  235-237,  250- 
255;  III:  140-142,  248-249 
Sequence  and  structure  of  learning 
objectives,  determing,  II:  79-96 
common-factor  learning  objectives, 
II:  90-92 

determining  relationships.  II: 
81-82,  83 

grouping,  II:  92-94 
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Sequence  and  structure  of  learning 
objectives,  determining  (contin- 
ued) 

outputs,  II:  94 
procedures,  II:  81-93 
purposes  of,  II:  79-80,  88-89 
with  dependent  relationships, 

II:  82-G7 

with  Independent  relationships, 
II:  90 

with  supportive  relationships, 
II:  87-88 

Setting,  see  Instructional  set- 
ting, selection  of 
Shaping,  III:  55,  57 
Simulator  requirements  In  Job 
Performance  Measures,  I:  163, 
172-176 

Slide- tape  production.  III:  239- 
244 

Soft  data,  V:  4 

Source  materials,  of  job  analysis 
data  and  job  information,  I: 
97-98 

of  training  courses  and  in- 
structional materials,  I: 
95-97 

Staff  training,  instructional, 

IV:  7-12 

Standards,  Job  Performance 
Measures,  i:  180-184 
task,  I:  28-33 
terminal  learning  objective 
test,  II:  47-50 
training,  II:  47-50 
State-of-the-art,  III:  120 
Steering  and  guiding:  learning 
sub-category  8,  III:  56-57, 
94-95 

Stimulus  criteria  (media).  III: 
107-108 

Storyboards,  III:  234,  239-242, 
245-246 

Student  management  plans,  see 
Management  plans,  student  and 
Instructional  management  pTan 
Student  self-managed  instruction, 
III:  195,  215 
Students'  Guide,  III:  269 
Students'  manual,  I.:  6 
Subject  Matter  Experts  (SMEs), 

I:  79,  81-82,  133 


Supplementary  Instruction,  III:  249- 
250 

System  Master  Plan  (SMP),  III:  105, 
107,  138-142;  V:  10,  90-91 
System  revision,  V:  87-120 

based  on  changes  in  doctrine  or 
content  of  DOS,  V:  94 
based  on  efficiency  of  Instruc- 
tion, V:  96-103 
based  on  External  Evaluation 
Report,  V:  95-96 
based  on  Internal  Evaluation 
Report,  V:  95 
description  of,  V:  87-89 
follow-up  activity,  V:  115 
for  Improvement  of  instructional 
effectiveness,  V:  109-112 
for  operating  instruction,  V: 
105-106 

for  time  reduction,  V:  106-109 
guidelines  for  determining  revi- 
sion needs,  V:  103-112 
outputs,  V:  115-116 
preparation  of  revision  plan, 

V:  112-114 

priority  ratings  for,  V:  92 
procedures  for,  V:  93-115 
purposes  of,  V:  87-90,  93 
sources  for,  V:  90-91 


Task(s),  I:  12 

checklist  task  inventory,  I: 
152-154 

clustering  of,  I:  244-245 
conditions  statement  for,  I:  24- 
26,  89-93 

delay  tolerance,  I:  123-125,  246 
guidelines  for  diagramming,  I: 

24 

inventory,  verifying  and  validat- 
ing, I:  66-68 

Job  Performance  Measures  for,  I: 
157-211 

multiple,  I:  164-165 
statements,  I:  13-17,  61 
unitary,  I:  164 

validated  task  list,  sample,  I: 
33,  86 

Task  selection,  I:  113-155 

criteria  for,  I:  118-133,  152- 
154 
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Task  selection  (continued) 
data  assessing  and  tfe'cision- 
maklng  for,  I:  139-148 
data  collection  for,  I:  134-136 
data  consolidation  for,  I:  136- 
139 

management  constraints,  I:  143- 
144 

outputs,  I:  117,  148-149 
procedures,  I:  117-148 
rationale  for,  I:  115-117 
survey  sources,  I:  133-134 
Television  producer  (production 
personnel).  III:  229 
Television  program  production.  III: 
244 

Terminal  learning  objectives  (TLOs), 
II:  1-31 

action  statement  of,  II:  5-12 
conditions  statement  of,  II:  5-6, 
9-10,  13-14 

guidelines  for  learner,  III:  4 
learning  analysis  for,  II:  18-30 
learning  categories,  II:  16-17 
standards  statement  of,  II:  5-6, 
9-10,  14-16 

Test  development,  II:  35-61 
attitudes  testing,  II:  45-46 
information  testing,  II:  42-44 
Inputs,  II:  7 

mental  skills  testing,  II:  39-42 
mi sclassifi cations,  II?  50-52 
outputs,  II:  37,  60 
physical  skills  testing,  II:  44-45 
procedures,  II:  38-60 
purposes,  II:  35 
rank-order  testing,  II:  52-55 
scoring,  II:  55-56 
standards,  II:  47-50 
types  of  tests,  II:  35,  38-39 
Testing  constraints  in  Job  Perform- 
ance Measures,  I:  166-177 
Trainer  Appraisal  Kit  (TAK),  IV: 

7-12 

Trainer  Development  Program  (TRADEP), 
IV:  9 

Training  Extension  Course  (TEC), 

Army,  III:  141-142 
Training  programs,  selection  of 
tasks  for,  I:  1H-133,  139-148 
Training  task  categories,  see 
Learning  categories 


Trial  report  (small  group),  example, 
III:  340-345 


Voice  communicating:  learning  sub 
category  10,  III:  63-65,  100- 
102 


Writer  (production  personnel),  III: 

229 
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